-- Logs begin at Wed 2022-05-25 15:26:04 UTC, end at Wed 2022-05-25 16:39:53 UTC. -- May 25 16:11:05.059661 dv-cinder-843278-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 25 16:11:05.068972 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 25 16:11:05.070991 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 25 16:11:05 2022] *** May 25 16:11:05.070991 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 25 16:11:05.070991 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 25 16:11:05.070991 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: nodename: dv-cinder-843278-2-iscsi May 25 16:11:05.070991 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: machine: x86_64 May 25 16:11:05.070991 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: clock source: unix May 25 16:11:05.070991 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: pcre jit disabled May 25 16:11:05.070991 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: detected number of CPU cores: 4 May 25 16:11:05.070991 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: current working directory: / May 25 16:11:05.070991 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: detected binary path: /usr/bin/uwsgi-core May 25 16:11:05.071670 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: your processes number limit is 47680 May 25 16:11:05.071670 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: your memory page size is 4096 bytes May 25 16:11:05.071670 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: detected max file descriptor number: 2048 May 25 16:11:05.071670 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: lock engine: pthread robust mutexes May 25 16:11:05.071670 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: thunder lock: enabled May 25 16:11:05.071670 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 25 16:11:05.071670 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 25 16:11:05.116998 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: Python main interpreter initialized at 0x558e8da629c0 May 25 16:11:05.116998 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: python threads support enabled May 25 16:11:05.116998 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: your server socket listen backlog is limited to 100 connections May 25 16:11:05.116998 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: your mercy for graceful operations on workers is 90 seconds May 25 16:11:05.117392 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: mapped 403077 bytes (393 KB) for 2 cores May 25 16:11:05.117469 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: *** Operational MODE: preforking *** May 25 16:11:05.117690 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: *** uWSGI is running in multiple interpreter mode *** May 25 16:11:05.117690 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: spawned uWSGI master process (pid: 103072) May 25 16:11:05.117922 dv-cinder-843278-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 25 16:11:05.118718 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: spawned uWSGI worker 1 (pid: 103073, cores: 1) May 25 16:11:05.118916 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: spawned uWSGI worker 2 (pid: 103074, cores: 1) May 25 16:11:05.119069 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 25 16:11:06.312179 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 25 16:11:06.315253 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 25 16:11:07.047477 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 16:11:07.047477 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: from cryptography.utils import int_from_bytes May 25 16:11:07.047807 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 16:11:07.047807 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: from cryptography.utils import int_from_bytes May 25 16:11:07.052477 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 16:11:07.052477 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: from cryptography.utils import int_from_bytes May 25 16:11:07.052814 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 16:11:07.052814 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: from cryptography.utils import int_from_bytes May 25 16:11:09.701936 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 16:11:09.702485 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 16:11:09.702633 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 16:11:09.703003 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 16:11:09.703258 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 16:11:09.703652 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.703757 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 16:11:09.704125 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 16:11:09.704213 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.704308 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.704483 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 16:11:09.704591 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.705431 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.705551 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 16:11:09.705771 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.705930 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 16:11:09.706089 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.706243 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.706502 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.706601 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.706827 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.706928 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.707151 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.707245 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.707483 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.707574 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.707790 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.707885 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843278-2-iscsi {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.708120 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.708222 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.708429 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.708524 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.708749 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.708894 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.709073 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.709160 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.709383 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.709471 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.709729 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.709852 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843278-2-iscsi {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.710052 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.710217 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.710433 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.710590 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.710744 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.711711 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.711856 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.711978 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.712103 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.712235 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.712359 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.712479 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.712611 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.712740 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.712862 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.713010 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.713133 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.713259 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.713380 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.713489 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.713617 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.713760 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.713883 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.713993 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.714118 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.714249 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843278-2-iscsi {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.714361 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.714486 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.714695 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.714827 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.714956 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.715075 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.715259 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.715493 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.715627 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.715807 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.715961 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843278-2-iscsi {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.716122 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.716282 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.716440 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.716606 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.716778 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.716894 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.717059 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.717310 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.717435 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.717629 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.717795 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.717984 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.718139 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.718339 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.718465 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.718592 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.718715 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.718896 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.719030 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.719228 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.719353 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.719549 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.719672 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.719854 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.719979 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.720163 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.720289 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.720546 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.721196 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.721387 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.721533 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.721737 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.721882 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.722074 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.722200 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.722384 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.722510 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.722634 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.722754 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.722969 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.723107 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.723230 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.723351 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.723518 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.723644 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.723831 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.723968 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.724143 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.724270 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.724433 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.724558 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.724693 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.724818 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.736486 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.736619 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.736619 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.736850 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.736997 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.737130 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.737264 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.737446 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.737595 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.737752 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.737897 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.738032 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.738032 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.738266 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.738394 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.738534 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.738669 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.738791 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.738913 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.739033 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.739153 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.739292 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.739421 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.739543 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.739664 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.739791 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.739914 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.740043 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.740178 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.740313 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.740450 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.740591 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.740724 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.740855 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.740978 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.741099 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.741259 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.741384 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.741513 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.741643 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.741789 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.741913 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.742034 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.742153 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.742282 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.742412 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.742412 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.742649 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.742769 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.742902 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.743033 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.743155 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.743275 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.743396 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.743515 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.743643 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.743773 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.743894 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.744022 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.744144 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.744271 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.744400 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.744522 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.744642 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.744769 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.744892 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.745020 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.745223 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.745347 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.745686 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.745829 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.745950 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.746082 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.746214 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.746337 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.746552 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.746678 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.746807 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.746935 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.747068 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.747190 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.747320 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.747447 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.747577 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.747700 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.747830 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.747953 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.748073 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.748195 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.748324 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.748447 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.748577 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.748708 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.748830 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.748951 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.749073 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.749193 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.749325 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.749449 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.749575 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.749699 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.749857 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.749992 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.750125 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.750255 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.750378 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.750498 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.750620 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.750747 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.750883 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.751006 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.751127 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.751248 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.751369 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.751498 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.751620 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.751785 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.752000 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.752168 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.752345 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.752553 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.752755 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.752967 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.753113 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.753238 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.753360 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.753497 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.753621 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.753782 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.753907 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.754043 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.754167 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.754296 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.754420 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.754540 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.754660 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.754789 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.754921 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.755044 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.755165 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.755293 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.755435 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.755753 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.755896 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.756029 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.756151 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.756272 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.756404 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.756550 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.756783 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.756910 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.757032 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.757159 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.757282 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.757409 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.757552 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.757675 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.757817 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.757939 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.758060 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:11:09.758198 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.758328 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.758457 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.758579 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.758700 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.758820 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.758949 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.759081 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.759210 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.759332 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.759461 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.759589 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.759720 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.759850 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.759972 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.760093 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.760222 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.760356 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.760489 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.760610 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.760730 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.760849 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.760969 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.761113 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.761250 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.761373 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.761494 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.761614 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.761759 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.761894 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.762026 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.762155 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.762155 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.762397 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.762527 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.762665 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.762795 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.762918 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.763039 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.763169 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.764544 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.764764 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.764892 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.765021 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.765144 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.765282 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.765407 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.765542 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.765665 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.765888 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.765888 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.765888 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.765888 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.765888 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.765888 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.765888 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.765888 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.768508 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.768508 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.768508 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.768508 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.768508 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.769206 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.769331 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.769461 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.769586 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.769708 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.769708 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.769954 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.770094 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.770094 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.770337 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.770466 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.772838 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.772979 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.773114 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.773253 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.773378 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.773508 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.773631 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.773631 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.774052 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.774258 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.774450 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.774643 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.774838 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.774972 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.775105 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.775229 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.775357 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.775479 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.775609 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.775731 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.775861 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.775861 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.778096 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.778236 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.778236 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.778483 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.778620 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.778620 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.778858 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.778965 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.778965 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.779202 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.779333 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.779333 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.779562 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.779692 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.779823 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.779954 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.780087 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.780210 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.780331 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.780451 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.780572 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.780704 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.780839 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.780962 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.781083 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.781212 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.781347 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.781479 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.781602 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.781737 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.782111 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.782234 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.782372 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.782496 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.782618 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.782738 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.782859 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.783629 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.783848 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.784058 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.784251 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.784455 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.784659 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.784878 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.785096 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.785238 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.785363 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.785485 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.785606 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.785812 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.786016 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.786200 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.786393 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.786592 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.786759 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.786900 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.787025 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.787167 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.787303 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.787428 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.787550 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.787686 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.787910 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.788048 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.788172 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.788293 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.788433 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.788570 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.788701 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.788824 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.788992 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.789137 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.789321 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.789499 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.789625 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.789761 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.789883 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.790004 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.790140 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.790264 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.790417 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.790613 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.790744 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.790866 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.791001 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.791123 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.791243 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.791363 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.791483 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.791604 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.791738 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.791867 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.791989 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.792116 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.792238 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.792359 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.792500 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.792623 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.792746 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.792919 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.793048 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.793179 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.793302 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.793424 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.793545 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.793674 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.793837 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.794010 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.794154 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.794277 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.794452 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.794591 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.794591 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.794833 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.794957 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.795122 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.795275 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.795409 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.795533 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.795663 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.795787 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.795917 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.796040 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.796168 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.796292 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.796530 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.796707 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.796847 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.796969 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.797091 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.797285 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.797417 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.797547 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.797670 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.797809 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.798030 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.798174 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.798298 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.798426 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.798757 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.799032 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.799160 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.799282 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.799387 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.799508 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.799631 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.799736 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.799839 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.799951 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.800064 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.800167 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.800276 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.800399 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.800520 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.800652 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.800776 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.800896 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.801018 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.801139 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.801277 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.801400 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.801521 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.801643 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.801820 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.801945 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.802080 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.802204 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.802326 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.802446 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.802566 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.802697 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.802829 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.802951 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.803071 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.803192 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.803313 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.803451 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.803581 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.803704 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.803824 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.803945 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.804065 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.804195 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.804306 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.804375 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.804447 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.804514 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.804583 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.804657 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.804782 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.804904 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.805025 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.805146 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.805268 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.805399 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.805522 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.805642 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.805788 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.805913 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.806034 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.806034 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.806274 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.806395 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.806515 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.806636 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.806769 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.806898 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.807021 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.807131 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.807239 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.807347 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.807475 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.807597 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.807717 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.807838 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.807958 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.808164 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.808303 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.808427 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.808548 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.808668 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.808789 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.808910 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.809044 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.809168 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.809308 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.809439 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.809562 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.809696 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.809854 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.809976 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.810097 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.810235 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.810359 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.810509 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.810634 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.810755 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.810875 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.810996 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.811124 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.811259 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.811382 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.811503 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.811624 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.811745 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.811865 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.811999 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.812129 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.812252 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.812373 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.812493 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.812629 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.812752 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.812873 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.812994 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.813113 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.813233 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.813362 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.813486 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.813613 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.813784 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.813908 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.814040 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.814194 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.814320 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.814498 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.814684 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.814883 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.815029 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.815162 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.815286 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.815415 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.815538 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.815659 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.815799 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.815923 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.816044 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.816166 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.816294 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.816424 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.816424 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.816672 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.816804 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.816926 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.817047 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.817167 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.817296 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.817408 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.817527 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.817648 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.817786 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.817909 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.818047 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.818185 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.818376 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.818508 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.818631 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.818764 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.818898 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.819107 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.819237 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.819358 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.819358 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.819585 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.819690 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.819817 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.819942 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.820062 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.820183 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.820310 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.820441 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.820564 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.820685 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.820814 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.820937 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.821065 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.821196 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.821319 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.821438 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.821438 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.821664 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.821831 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.821964 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.822096 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.822219 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.822346 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.822469 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.822589 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.822717 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.822848 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.822983 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.823107 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.823228 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.823347 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.823450 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.823581 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.823712 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.823841 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.823964 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.824084 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.824213 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.824336 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.824441 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.824569 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.824693 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.824693 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.824928 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.824928 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.825159 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.825261 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.825353 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.825432 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.825518 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.825597 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.825681 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.825778 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.825858 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.825935 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.826025 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.826105 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.826183 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.826267 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.826347 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.826432 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.826511 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.826635 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.826755 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.826888 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.827010 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.827140 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.827263 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.827385 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.827505 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.827642 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.827773 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.827905 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.828028 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.828155 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.828278 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.828413 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.828610 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.828743 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.828867 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.828986 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.829118 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.829241 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.829419 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.829547 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.829736 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.830403 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.830614 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.830825 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.831048 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.831235 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.831372 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.831498 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.831619 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.831751 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.831888 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.832011 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.832128 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.832311 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.832440 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.832618 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.832754 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.832934 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.833061 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.833244 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.833369 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.833560 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.833687 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.833894 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.834020 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.834201 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.834325 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.834509 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.834638 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.834816 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.834939 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.835124 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.835257 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.835429 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.835554 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.835732 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.835864 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.836038 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.836161 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.836345 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.836470 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.836658 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.836784 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.836970 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.837110 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.837272 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.837396 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.837638 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.837838 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.837963 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.838097 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.838222 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.838343 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.838496 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.838643 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.838831 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.838966 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.839098 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.839221 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.839388 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.839522 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.839693 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.839832 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.839997 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.840131 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.840302 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.840433 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.840617 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.840743 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.840926 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.841050 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.841235 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.841366 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.841542 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.841669 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.841874 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.842002 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.842227 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.842417 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.842620 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.842746 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.842875 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.842999 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.843169 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.843382 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.843522 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.843647 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.843797 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.843923 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.844103 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.844236 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.844414 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.844539 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.844725 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.844850 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.845028 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.845166 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.845348 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.846156 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.846349 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.846552 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.846770 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.846930 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.847056 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.847180 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.847301 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.847423 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.847545 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.847691 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.847882 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.848008 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.848141 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.848319 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.848460 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.848645 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.848777 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.848976 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.849102 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.849271 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.849406 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.849586 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.849740 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.849934 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.850060 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.850244 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.850381 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.850564 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.850689 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.850879 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.851005 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.851189 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.851322 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.851496 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.851620 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.851806 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.851930 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.852123 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.852262 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.852437 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.852563 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.852748 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.852874 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.853058 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.853183 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.853376 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.853510 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.853683 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.853865 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.854023 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.854149 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.854334 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.854459 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.854642 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.854768 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.854951 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.855083 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.855257 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.855381 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.855565 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.855690 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.855868 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.855994 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.856180 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.856313 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.856497 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.856637 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.856812 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.856937 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.857127 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.857252 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.857484 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.857618 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.857922 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.858068 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.858194 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.858314 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.858512 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.858649 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.858820 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.858960 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.859174 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.859300 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.859483 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.859617 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.859797 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.859925 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.860106 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.860231 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.860419 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.860546 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.860721 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.860853 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.861052 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.861318 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.861533 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.861788 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.861970 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.862098 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.862236 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.862367 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.862494 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.862616 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.862737 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.862866 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.862996 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.863182 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.863321 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.863502 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.863628 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.863813 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.863938 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.864231 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.864356 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.864546 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.864669 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.864863 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.864996 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.865178 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.865304 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.865486 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.865612 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.865816 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.865944 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.866130 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.866257 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.866458 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.866583 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.866768 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.866893 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.867077 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.867210 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.867383 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.867516 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.867711 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.867847 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.868017 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.868141 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.868333 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.868456 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.868640 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.868774 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.868967 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.869199 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.869403 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.869529 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.869651 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.869790 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.869946 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.870087 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.870366 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.870494 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.870696 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.870823 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.871010 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.871147 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.871335 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.871460 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.871645 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.871771 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.871960 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.872093 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.872269 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.872397 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.872584 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.872717 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.872893 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.873021 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.873207 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.873333 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.873523 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.873650 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.873855 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.873984 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.874169 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.874293 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.874482 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.874610 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.874795 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.874922 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.875101 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.875227 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.875407 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.875534 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.875729 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.875856 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.876035 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.876162 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.876361 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.876496 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.876703 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.876894 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.877095 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.877296 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.877498 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.877668 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.877820 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.877944 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.878153 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.878277 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.878449 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.878594 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.878767 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.878894 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.879080 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.879215 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.879442 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.879588 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.879739 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.879866 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.880049 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.880174 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.880373 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.880502 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.880687 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.880813 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.881018 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.881144 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.881329 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.881456 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.881659 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.881844 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.882009 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.882135 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.882328 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.882455 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.882652 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.882779 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.882961 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.883086 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.883281 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.883406 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.883607 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.883741 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.883923 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.884136 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.884263 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.884529 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.884665 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.884832 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.885144 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.885279 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.885514 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.885859 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.885999 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.886138 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.886445 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.886599 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.886725 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.886846 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.886968 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.887319 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.887457 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.887629 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.887940 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.888074 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.888333 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.888466 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.888709 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.888845 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.889108 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.889272 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.889447 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.889704 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.889870 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.890003 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.890126 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.890249 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.890377 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.890508 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.890640 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.890770 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.890922 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.891050 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.891241 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.891382 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.891555 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.891681 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.891871 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.891997 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.892189 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.892868 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.893067 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.893257 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.893470 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.893689 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.893689 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.894079 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.894079 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.894324 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.894448 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.894577 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.894701 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.894831 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.894955 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.895077 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.895199 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.895450 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.895579 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.895780 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.895916 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.896099 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.896226 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.896419 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.896562 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.896736 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.896984 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.897167 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.897362 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.897490 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.897623 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.897785 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.897912 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.898047 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.898172 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.898294 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.898507 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.898637 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.898832 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.898960 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.899160 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.899300 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.899482 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.899616 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.899821 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.899954 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.900109 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.900244 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.900430 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.900556 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.900751 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.900877 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.901066 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.901205 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.901384 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.901515 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.901703 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.901862 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.902052 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.902177 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.902371 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.902614 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.902739 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.902946 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.903084 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.903267 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.903401 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.903583 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.903715 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.903900 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.904033 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.904214 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.904339 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.904529 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.904654 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.904840 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.904966 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.905153 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.905285 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.905468 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.905592 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.905802 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.905931 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.906139 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.906265 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.906466 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.906593 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.907042 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.907178 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.907363 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.907491 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.907682 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.907817 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.908716 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.908929 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.909144 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.909328 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.909444 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.909579 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.909744 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.909951 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.910078 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.910213 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.910348 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.910472 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.910594 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.910715 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.910838 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.910959 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.911132 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.911260 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.911450 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.911576 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.911768 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.911894 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.912088 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.912217 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.912409 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.912535 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.912724 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.912851 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.913040 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.913155 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.913363 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.913497 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.913661 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.913828 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.913998 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.914130 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.914340 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.914542 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.914677 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.914895 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.915060 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.915197 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.915320 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.915516 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.915629 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.915847 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.916090 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.916217 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.916409 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.916535 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.916747 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.916875 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.917074 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.917199 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.917384 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.917519 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.917705 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.917899 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.918033 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.918157 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.918332 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.918458 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.918641 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.918786 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.918977 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.919102 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.919252 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.919384 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.919559 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.919687 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.919863 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.920070 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.920195 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.920326 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.920478 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.920605 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.920786 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.920915 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.921094 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.921258 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.921386 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.921584 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.921731 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.922022 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.922147 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.922329 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.922502 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.922637 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.922823 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.922950 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.923157 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.923296 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.923487 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.923726 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.923928 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.924093 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.924229 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.924558 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.924683 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.924872 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.924998 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.925187 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.925322 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.925497 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.925622 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.925847 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.925977 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.926168 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.926303 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.926475 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.926608 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.926784 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.926910 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.927094 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.927228 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.927408 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.927539 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.927717 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.927844 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.928028 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.928154 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.928335 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.928461 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.928665 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.928791 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.928977 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.929215 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.929350 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.929555 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.929688 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.929907 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.930060 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.930263 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.930396 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.930521 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.930642 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.930799 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.930935 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.931105 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.931239 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.931419 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.931545 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.931725 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.931853 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.932035 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.932163 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.932342 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.932468 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.932656 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.932783 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.932964 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.933099 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.933271 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.933397 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.933590 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.933749 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.933930 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.934069 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.934244 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.934372 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.934554 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.934679 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.934862 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.934973 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.935174 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.935298 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.935485 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.935574 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.935796 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.935885 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.936105 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.936238 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.936446 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.936570 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.936763 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.936893 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.937080 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.937400 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.937532 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.937736 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.937866 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.938054 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.938193 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.938370 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.938497 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.938683 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.938810 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.938998 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.939139 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.939361 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.939576 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.939783 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.940452 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.940563 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.940677 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.940801 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.940930 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.941051 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.941174 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.941296 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.941426 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.941551 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.941673 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.941837 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.941963 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.942094 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.942230 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.942354 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.942476 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.942597 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.942719 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.942883 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.943012 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.943193 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.943320 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.943506 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.943640 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.943820 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.943955 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.944134 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.944268 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.944453 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.944659 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.944787 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.944915 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.945089 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.945215 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.945397 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.945532 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.945706 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.945885 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.946041 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.946175 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.946353 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.946488 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.946665 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.946792 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.946974 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.947108 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.947280 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.947416 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.947594 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.947727 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.947900 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.948035 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.948208 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.948336 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.948514 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.948647 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.948820 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.948948 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.949130 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.949258 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.949435 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.949561 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.949758 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.949917 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.950057 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.950235 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.950376 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.950564 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.950689 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.950880 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.951010 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.951199 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.951325 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.951523 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.951655 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.951830 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.952002 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.952142 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.952272 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.952426 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.952552 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.952731 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.952864 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.953064 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.953190 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.953399 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.953534 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.953763 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.953891 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.954055 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.954183 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.954368 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.954506 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.954690 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.955315 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.955516 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.955708 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.955906 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.956129 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.956293 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.956433 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.956557 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.956744 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.956870 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.957057 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.957183 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.957370 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.957496 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.957679 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.957884 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.958019 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.958132 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.958330 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.958444 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.958641 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.958767 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.958950 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.959073 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.959267 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.959387 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.959582 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.959703 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.959886 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.960012 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.960190 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.960315 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.960505 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.960712 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.960837 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.960959 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.961090 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.961214 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.961394 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.961529 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.961701 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.961894 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.962019 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.962141 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.962352 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.962486 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.962670 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.962805 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.962980 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.963107 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.963291 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.963420 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.963601 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.963727 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.963917 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.964051 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.964227 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.964352 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.964553 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.964689 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.964868 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.965002 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.965199 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.965332 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.965528 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.965654 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.965908 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.966049 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.966224 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.966351 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.966537 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.966662 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.966851 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.966991 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.967166 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.967300 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.967477 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.967604 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.967782 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.967915 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.968039 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 16:11:09.968162 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.968430 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.968741 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.969072 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.969395 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.969736 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.970062 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.970525 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.971413 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.971764 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.972135 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.972460 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.972777 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.973094 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.973418 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.973759 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.974098 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.974430 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.974747 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.975081 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.975415 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.975768 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.976085 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.976434 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.976766 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.977068 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.977928 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.977928 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:11:09.977928 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 16:11:10.027874 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO dbcounter [None req-70ab2abb-b29e-4c81-81af-eeaed1c4fb93 None None] Registered counter for database nova_api May 25 16:11:10.038429 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO dbcounter [None req-f892123a-707c-4633-abf3-e647881b3022 None None] Registered counter for database nova_api May 25 16:11:10.051059 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG oslo_db.sqlalchemy.engines [None req-70ab2abb-b29e-4c81-81af-eeaed1c4fb93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:11:10.058669 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG oslo_db.sqlalchemy.engines [None req-f892123a-707c-4633-abf3-e647881b3022 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103074) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:11:10.061128 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG dbcounter [-] [103073] Writer thread running {{(pid=103073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:11:10.066019 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG dbcounter [-] [103074] Writer thread running {{(pid=103074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:11:10.120193 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.context [None req-70ab2abb-b29e-4c81-81af-eeaed1c4fb93 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0666b19a-5b2e-43ea-b2cf-5adf4d938b08(cell1) {{(pid=103073) load_cells /opt/stack/nova/nova/context.py:464}} May 25 16:11:10.124549 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG oslo_concurrency.lockutils [None req-70ab2abb-b29e-4c81-81af-eeaed1c4fb93 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:10.124829 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.context [None req-f892123a-707c-4633-abf3-e647881b3022 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0666b19a-5b2e-43ea-b2cf-5adf4d938b08(cell1) {{(pid=103074) load_cells /opt/stack/nova/nova/context.py:464}} May 25 16:11:10.126209 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG oslo_concurrency.lockutils [None req-70ab2abb-b29e-4c81-81af-eeaed1c4fb93 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:10.127562 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG oslo_concurrency.lockutils [None req-70ab2abb-b29e-4c81-81af-eeaed1c4fb93 None None] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:10.129513 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG oslo_concurrency.lockutils [None req-f892123a-707c-4633-abf3-e647881b3022 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:10.129654 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG oslo_concurrency.lockutils [None req-70ab2abb-b29e-4c81-81af-eeaed1c4fb93 None None] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:10.131161 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG oslo_concurrency.lockutils [None req-f892123a-707c-4633-abf3-e647881b3022 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:10.131654 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO dbcounter [None req-70ab2abb-b29e-4c81-81af-eeaed1c4fb93 None None] Registered counter for database nova_cell0 May 25 16:11:10.132961 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG oslo_concurrency.lockutils [None req-f892123a-707c-4633-abf3-e647881b3022 None None] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:10.135011 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG oslo_concurrency.lockutils [None req-f892123a-707c-4633-abf3-e647881b3022 None None] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:10.135866 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO dbcounter [None req-70ab2abb-b29e-4c81-81af-eeaed1c4fb93 None None] Registered counter for database nova_cell1 May 25 16:11:10.137153 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO dbcounter [None req-f892123a-707c-4633-abf3-e647881b3022 None None] Registered counter for database nova_cell0 May 25 16:11:10.141230 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO dbcounter [None req-f892123a-707c-4633-abf3-e647881b3022 None None] Registered counter for database nova_cell1 May 25 16:11:10.146755 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG oslo_db.sqlalchemy.engines [None req-70ab2abb-b29e-4c81-81af-eeaed1c4fb93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:11:10.147683 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG oslo_db.sqlalchemy.engines [None req-70ab2abb-b29e-4c81-81af-eeaed1c4fb93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:11:10.149854 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG oslo_db.sqlalchemy.engines [None req-f892123a-707c-4633-abf3-e647881b3022 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103074) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:11:10.155040 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG dbcounter [-] [103073] Writer thread running {{(pid=103073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:11:10.157263 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG dbcounter [-] [103073] Writer thread running {{(pid=103073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:11:10.157426 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG dbcounter [-] [103074] Writer thread running {{(pid=103074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:11:10.158604 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG oslo_db.sqlalchemy.engines [None req-f892123a-707c-4633-abf3-e647881b3022 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103074) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:11:10.302928 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG dbcounter [-] [103074] Writer thread running {{(pid=103074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:11:10.305039 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO dbcounter [None req-70ab2abb-b29e-4c81-81af-eeaed1c4fb93 None None] Registered counter for database nova_cell0 May 25 16:11:10.311957 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG oslo_db.sqlalchemy.engines [None req-70ab2abb-b29e-4c81-81af-eeaed1c4fb93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:11:10.312128 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO dbcounter [None req-f892123a-707c-4633-abf3-e647881b3022 None None] Registered counter for database nova_cell0 May 25 16:11:10.316725 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG dbcounter [-] [103073] Writer thread running {{(pid=103073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:11:10.321069 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG oslo_db.sqlalchemy.engines [None req-f892123a-707c-4633-abf3-e647881b3022 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103074) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:11:10.325706 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG dbcounter [-] [103074] Writer thread running {{(pid=103074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:11:10.655608 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: WARNING keystonemiddleware.auth_token [None req-70ab2abb-b29e-4c81-81af-eeaed1c4fb93 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 16:11:10.662294 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: WARNING keystonemiddleware.auth_token [None req-f892123a-707c-4633-abf3-e647881b3022 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 16:11:10.663965 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: WARNING keystonemiddleware.auth_token [None req-70ab2abb-b29e-4c81-81af-eeaed1c4fb93 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 16:11:10.669506 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: WARNING keystonemiddleware.auth_token [None req-f892123a-707c-4633-abf3-e647881b3022 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 16:11:11.009942 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: WARNING keystonemiddleware.auth_token [None req-70ab2abb-b29e-4c81-81af-eeaed1c4fb93 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 16:11:11.015822 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: WARNING keystonemiddleware.auth_token [None req-70ab2abb-b29e-4c81-81af-eeaed1c4fb93 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 16:11:11.021119 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558e8da629c0 pid: 103073 (default app) May 25 16:11:11.023227 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-70ab2abb-b29e-4c81-81af-eeaed1c4fb93 None None] Calling method '>' {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:11.023474 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: WARNING keystonemiddleware.auth_token [None req-f892123a-707c-4633-abf3-e647881b3022 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 16:11:11.024415 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-70ab2abb-b29e-4c81-81af-eeaed1c4fb93 None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001758 May 25 16:11:11.024830 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Wed May 25 16:11:11 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:11:11.029650 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: WARNING keystonemiddleware.auth_token [None req-f892123a-707c-4633-abf3-e647881b3022 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 16:11:11.035831 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558e8da629c0 pid: 103074 (default app) May 25 16:12:31.244846 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-70ab2abb-b29e-4c81-81af-eeaed1c4fb93 None None] Calling method '>' {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:31.246040 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-70ab2abb-b29e-4c81-81af-eeaed1c4fb93 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 May 25 16:12:31.246493 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 930 bytes} [Wed May 25 16:12:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:12:31.264491 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG dbcounter [-] [103074] Writing DB stats nova_api:SELECT=3 {{(pid=103074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:12:31.265451 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG dbcounter [-] [103074] Writing DB stats nova_cell0:SELECT=3 {{(pid=103074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:12:31.266507 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG dbcounter [-] [103074] Writing DB stats nova_cell1:SELECT=3 {{(pid=103074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:12:31.267589 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG dbcounter [-] [103074] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:12:31.742995 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-f996395a-cd0a-4466-afe2-0e59cbc2697c admin admin] Calling method '>' {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:31.774272 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-f996395a-cd0a-4466-afe2-0e59cbc2697c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.519564 May 25 16:12:31.775379 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1291 bytes} [Wed May 25 16:12:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:34.122518 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-70ab2abb-b29e-4c81-81af-eeaed1c4fb93 None None] Calling method '>' {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:34.123517 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-70ab2abb-b29e-4c81-81af-eeaed1c4fb93 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 May 25 16:12:34.123932 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 930 bytes} [Wed May 25 16:12:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:12:34.190718 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-8927a4fe-48e4-490b-9bb4-75858f130318 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "cirros256", "id": "c1", "disk": 1, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:34.209924 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 16:12:34.209924 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: warnings.warn(msg) May 25 16:12:34.238025 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-8927a4fe-48e4-490b-9bb4-75858f130318 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.107316 May 25 16:12:34.238872 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1282 bytes} [Wed May 25 16:12:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:12:34.252748 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG dbcounter [-] [103073] Writing DB stats nova_api:SELECT=3 {{(pid=103073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:12:34.253869 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG dbcounter [-] [103073] Writing DB stats nova_cell0:SELECT=3 {{(pid=103073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:12:34.255635 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG dbcounter [-] [103073] Writing DB stats nova_cell1:SELECT=3 {{(pid=103073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:12:34.256520 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG dbcounter [-] [103073] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:12:34.471135 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-7647f617-d8ab-4e6b-b6e7-06f21fdc01ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:34.473690 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 16:12:34.473690 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: warnings.warn(msg) May 25 16:12:34.545005 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-7647f617-d8ab-4e6b-b6e7-06f21fdc01ac admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.298064 May 25 16:12:34.549813 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1335 bytes} [Wed May 25 16:12:34 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:36.858906 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-8927a4fe-48e4-490b-9bb4-75858f130318 admin admin] Calling method '>' {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:36.860554 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-8927a4fe-48e4-490b-9bb4-75858f130318 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 May 25 16:12:36.860988 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 930 bytes} [Wed May 25 16:12:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:12:36.988202 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-d5c40249-6690-4791-ac3f-b7008f9d0c01 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "name": "ds512M", "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "disk": 5, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:37.007361 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 16:12:37.007361 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: warnings.warn(msg) May 25 16:12:37.027459 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-d5c40249-6690-4791-ac3f-b7008f9d0c01 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.160219 May 25 16:12:37.027940 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1282 bytes} [Wed May 25 16:12:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:12:37.040604 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-958764dd-db4f-4de8-8590-98210ae7b8c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:37.042479 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 16:12:37.042479 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: warnings.warn(msg) May 25 16:12:37.076397 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-958764dd-db4f-4de8-8590-98210ae7b8c4 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039462 May 25 16:12:37.076990 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1335 bytes} [Wed May 25 16:12:37 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:39.598272 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-d5c40249-6690-4791-ac3f-b7008f9d0c01 admin admin] Calling method '>' {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:39.599300 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-d5c40249-6690-4791-ac3f-b7008f9d0c01 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 May 25 16:12:39.599726 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 930 bytes} [Wed May 25 16:12:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:12:39.665271 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-bc5b6c7d-41d7-451a-836b-f5c6d587d142 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "disk": 10, "vcpus": 1, "ram": 1024, "os-flavor-access:is_public": true}} {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:39.683325 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-bc5b6c7d-41d7-451a-836b-f5c6d587d142 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077349 May 25 16:12:39.684113 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1282 bytes} [Wed May 25 16:12:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 16:12:39.697862 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-cb9878ec-1c26-44d3-99df-742da931891e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:39.725782 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-cb9878ec-1c26-44d3-99df-742da931891e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032688 May 25 16:12:39.727172 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1335 bytes} [Wed May 25 16:12:39 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:42.021946 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-bc5b6c7d-41d7-451a-836b-f5c6d587d142 admin admin] Calling method '>' {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:42.022972 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-bc5b6c7d-41d7-451a-836b-f5c6d587d142 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 May 25 16:12:42.023581 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 930 bytes} [Wed May 25 16:12:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:12:42.088503 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-4cc5f6b5-170f-4309-bbaf-d4abb4b75218 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds2G", "swap": 0}} {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:42.107740 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-4cc5f6b5-170f-4309-bbaf-d4abb4b75218 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077596 May 25 16:12:42.108303 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1282 bytes} [Wed May 25 16:12:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:12:42.121934 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-d7f93df9-3297-48bb-ad27-a3832c446e66 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:42.146709 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-d7f93df9-3297-48bb-ad27-a3832c446e66 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028547 May 25 16:12:42.147315 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1335 bytes} [Wed May 25 16:12:42 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:44.463270 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-4cc5f6b5-170f-4309-bbaf-d4abb4b75218 admin admin] Calling method '>' {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:44.464433 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-4cc5f6b5-170f-4309-bbaf-d4abb4b75218 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001604 May 25 16:12:44.465226 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 930 bytes} [Wed May 25 16:12:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:12:44.528512 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-f9254592-dcdd-4ca6-8eaa-0e2705503bb0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d4", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "vcpus": 4, "swap": 0}} {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:44.548488 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-f9254592-dcdd-4ca6-8eaa-0e2705503bb0 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076743 May 25 16:12:44.553755 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1282 bytes} [Wed May 25 16:12:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:12:44.561195 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-b9b891e0-a14c-4aee-bcde-f4beaa8ebce7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:44.592192 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-b9b891e0-a14c-4aee-bcde-f4beaa8ebce7 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034627 May 25 16:12:44.592800 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1335 bytes} [Wed May 25 16:12:44 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:46.877075 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-f9254592-dcdd-4ca6-8eaa-0e2705503bb0 admin admin] Calling method '>' {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:46.878139 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-f9254592-dcdd-4ca6-8eaa-0e2705503bb0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 May 25 16:12:46.878544 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 930 bytes} [Wed May 25 16:12:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:12:46.951539 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-07d3e7d6-4058-47bf-8978-b769e70248a1 admin admin] Calling method '>' {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:46.977771 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-07d3e7d6-4058-47bf-8978-b769e70248a1 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.092837 May 25 16:12:46.978547 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1291 bytes} [Wed May 25 16:12:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:12:49.297469 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-f9254592-dcdd-4ca6-8eaa-0e2705503bb0 admin admin] Calling method '>' {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:49.298577 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-f9254592-dcdd-4ca6-8eaa-0e2705503bb0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001650 May 25 16:12:49.299305 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 930 bytes} [Wed May 25 16:12:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:12:49.360475 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-35610eaa-dc7b-4126-9553-403f8786618a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "disk": 1}} {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:49.379221 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-35610eaa-dc7b-4126-9553-403f8786618a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.073961 May 25 16:12:49.379794 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1282 bytes} [Wed May 25 16:12:49 2022] POST /compute/v2.1/flavors => generated 402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:12:49.392730 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-b7f68629-a1ff-4820-bc06-fc6dc97f7998 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:49.419589 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-b7f68629-a1ff-4820-bc06-fc6dc97f7998 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031149 May 25 16:12:49.420403 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1332 bytes} [Wed May 25 16:12:49 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:12:51.932529 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-35610eaa-dc7b-4126-9553-403f8786618a admin admin] Calling method '>' {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:51.934256 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-35610eaa-dc7b-4126-9553-403f8786618a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002412 May 25 16:12:51.934869 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 930 bytes} [Wed May 25 16:12:51 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:12:51.998513 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-fd7cd12b-8f4a-4d1a-aca9-46cb31e2fda3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "disk": 20, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "id": "2", "ram": 2048, "rxtx_factor": 1.0}} {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:52.017169 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-fd7cd12b-8f4a-4d1a-aca9-46cb31e2fda3 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074276 May 25 16:12:52.017760 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1282 bytes} [Wed May 25 16:12:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 16:12:52.033679 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-cb76ea6b-865d-49dc-bd55-9dc84a5f3f5a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:52.059617 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-cb76ea6b-865d-49dc-bd55-9dc84a5f3f5a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029783 May 25 16:12:52.060228 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1332 bytes} [Wed May 25 16:12:52 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:12:54.812313 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-fd7cd12b-8f4a-4d1a-aca9-46cb31e2fda3 admin admin] Calling method '>' {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:54.813995 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-fd7cd12b-8f4a-4d1a-aca9-46cb31e2fda3 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002089 May 25 16:12:54.814405 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 930 bytes} [Wed May 25 16:12:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:12:54.873022 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-1bb24bbe-6b67-4ac4-ae79-0de503b40c6e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.medium", "disk": 40, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 4096, "id": "3", "rxtx_factor": 1.0}} {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:54.891566 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-1bb24bbe-6b67-4ac4-ae79-0de503b40c6e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071152 May 25 16:12:54.892102 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1282 bytes} [Wed May 25 16:12:54 2022] POST /compute/v2.1/flavors => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:12:54.904169 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-b3ab625f-d89c-4f05-b817-76659430e204 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:54.927652 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-b3ab625f-d89c-4f05-b817-76659430e204 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027421 May 25 16:12:54.928242 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1332 bytes} [Wed May 25 16:12:54 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:57.246279 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-1bb24bbe-6b67-4ac4-ae79-0de503b40c6e admin admin] Calling method '>' {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:57.247733 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-1bb24bbe-6b67-4ac4-ae79-0de503b40c6e admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001910 May 25 16:12:57.248127 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 930 bytes} [Wed May 25 16:12:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:12:57.307819 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-4c16b912-60b1-4a75-8029-b67731a20301 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "name": "m1.large", "disk": 80, "id": "4", "rxtx_factor": 1.0}} {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:57.327201 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-4c16b912-60b1-4a75-8029-b67731a20301 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072508 May 25 16:12:57.328072 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1282 bytes} [Wed May 25 16:12:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:12:57.341084 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-b7eb1555-9427-4932-8d24-2247b03cf60a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:57.364816 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-b7eb1555-9427-4932-8d24-2247b03cf60a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028124 May 25 16:12:57.365395 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1332 bytes} [Wed May 25 16:12:57 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:12:59.747694 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-4c16b912-60b1-4a75-8029-b67731a20301 admin admin] Calling method '>' {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:59.748707 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-4c16b912-60b1-4a75-8029-b67731a20301 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 May 25 16:12:59.749105 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 930 bytes} [Wed May 25 16:12:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:12:59.814182 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-0f087cc8-91c4-4e9d-a79e-0b35c74882ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "os-flavor-access:is_public": true, "name": "m1.xlarge", "disk": 160, "vcpus": 8, "swap": 0, "ram": 16384, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:59.834656 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-0f087cc8-91c4-4e9d-a79e-0b35c74882ad admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.078606 May 25 16:12:59.835209 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1282 bytes} [Wed May 25 16:12:59 2022] POST /compute/v2.1/flavors => generated 408 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:12:59.847007 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-da5fd126-b799-4918-bdbc-91d820f28838 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:59.870857 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-da5fd126-b799-4918-bdbc-91d820f28838 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027473 May 25 16:12:59.871443 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1332 bytes} [Wed May 25 16:12:59 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:13:24.067945 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-0f087cc8-91c4-4e9d-a79e-0b35c74882ad admin admin] Calling method '>' {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:24.068950 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-0f087cc8-91c4-4e9d-a79e-0b35c74882ad admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 May 25 16:13:24.069368 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 930 bytes} [Wed May 25 16:13:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:13:24.080122 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG dbcounter [-] [103074] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:13:24.129312 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-8378fe92-3d3f-41ca-bc24-a8cf7bbab33f admin admin] Calling method '>' {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:24.146134 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-8378fe92-3d3f-41ca-bc24-a8cf7bbab33f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070575 May 25 16:13:24.146666 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1291 bytes} [Wed May 25 16:13:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:25.142471 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-0f087cc8-91c4-4e9d-a79e-0b35c74882ad admin admin] Calling method '>' {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:25.143532 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-0f087cc8-91c4-4e9d-a79e-0b35c74882ad admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 May 25 16:13:25.143996 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1074 bytes} [Wed May 25 16:13:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:13:25.370235 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-ae11182f-1ffa-40b1-aef4-dcfe21e17ea6 admin admin] Calling method '>' {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:25.376987 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.wsgi [None req-ae11182f-1ffa-40b1-aef4-dcfe21e17ea6 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 25 16:13:25.380256 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-ae11182f-1ffa-40b1-aef4-dcfe21e17ea6 admin admin] Request method failure captured: May 25 16:13:25.380256 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 25 16:13:25.380256 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: Accept: application/json May 25 16:13:25.380256 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: Accept-Encoding: gzip, deflate May 25 16:13:25.380256 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: Connection: keep-alive May 25 16:13:25.380256 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: Content-Length: 0 May 25 16:13:25.380256 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: Host: 10.222.0.42 May 25 16:13:25.380256 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: Openstack-Api-Version: compute 2.90 May 25 16:13:25.380256 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: Openstack-System-Scope: None May 25 16:13:25.380256 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: User-Agent: python-novaclient May 25 16:13:25.380256 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Auth-Token: gAAAAABijlWllwUfxlonfsSAVeZc6yhsIr3unSUNFPbvD_SYgbsOK3-0JcACf6X31QtWqmECPXnlqn9pyENs4TKmN26_fDokZeq5qhEnFxYINCEClsRrwWjevZNSP2YH4GjYBvd6VZ9hSbRTg42rsvzXFMDZt41ej-sQkU4imuVKQf6sKY3fhEk May 25 16:13:25.380256 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Domain-Id: None May 25 16:13:25.380256 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Domain-Name: None May 25 16:13:25.380256 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Identity-Status: Confirmed May 25 16:13:25.380256 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Is-Admin-Project: True May 25 16:13:25.380256 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Openstack-Nova-Api-Version: 2.90 May 25 16:13:25.380256 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Project-Domain-Id: default May 25 16:13:25.380256 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Project-Domain-Name: Default May 25 16:13:25.380256 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Project-Id: 55f82ef7ffb1469ea7582069b5da4934 May 25 16:13:25.380256 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Project-Name: admin May 25 16:13:25.380256 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Role: reader,member,admin May 25 16:13:25.380256 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Roles: reader,member,admin May 25 16:13:25.382027 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55f82ef7ffb1469ea7582069b5da4934"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/55f82ef7ffb1469ea7582069b5da4934"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_55f82ef7ffb1469ea7582069b5da4934"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55f82ef7ffb1469ea7582069b5da4934"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:13:25.382027 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Tenant: admin May 25 16:13:25.382027 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Tenant-Id: 55f82ef7ffb1469ea7582069b5da4934 May 25 16:13:25.382027 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Tenant-Name: admin May 25 16:13:25.382027 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-User: admin May 25 16:13:25.382027 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-User-Domain-Id: default May 25 16:13:25.382027 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-User-Domain-Name: Default May 25 16:13:25.382027 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-User-Id: cada5de94a8d4bee93afa64a6b5b9d33 May 25 16:13:25.382027 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-User-Name: admin May 25 16:13:25.382027 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: method: > May 25 16:13:25.382027 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: exception: Flavor 42 could not be found. May 25 16:13:25.382027 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: action_args: {'id': '42'} May 25 16:13:25.382027 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:13:25.382027 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:25.383130 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 16:13:25.383130 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 16:13:25.383130 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 16:13:25.383130 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 16:13:25.383130 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 16:13:25.383130 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 16:13:25.383130 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 16:13:25.383130 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 16:13:25.383130 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 16:13:25.383130 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:13:25.383130 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 16:13:25.383130 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 16:13:25.383130 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 25 16:13:25.383130 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi May 25 16:13:25.383130 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:13:25.383130 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi May 25 16:13:25.383130 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:25.383130 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:13:25.383130 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:13:25.384515 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:13:25.384515 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:13:25.384515 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:13:25.384515 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:13:25.384515 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 16:13:25.384515 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 16:13:25.384515 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 25 16:13:25.384515 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi May 25 16:13:25.384515 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:13:25.384515 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi May 25 16:13:25.384515 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:25.384515 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:13:25.384515 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:13:25.384515 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:13:25.384515 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:13:25.384515 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 25 16:13:25.384515 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi May 25 16:13:25.384515 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-ae11182f-1ffa-40b1-aef4-dcfe21e17ea6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:13:25.385826 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-ae11182f-1ffa-40b1-aef4-dcfe21e17ea6 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063059 May 25 16:13:25.385826 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1190 bytes} [Wed May 25 16:13:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 16:13:25.392473 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-7f019cda-94eb-4c5b-a1cc-2120df27349d admin admin] Calling method '>' {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:25.395519 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG dbcounter [-] [103073] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:13:25.415726 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-7f019cda-94eb-4c5b-a1cc-2120df27349d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027765 May 25 16:13:25.416261 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1210 bytes} [Wed May 25 16:13:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:25.425992 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-71b77b4d-80fe-49f9-96d6-d2858638694c admin admin] Calling method '>' {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:25.448073 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-71b77b4d-80fe-49f9-96d6-d2858638694c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025683 May 25 16:13:25.448633 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1210 bytes} [Wed May 25 16:13:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:25.459718 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-88478fae-6789-4a35-8e4a-47f8d5225ddd admin admin] Calling method '>' {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:25.466152 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.wsgi [None req-88478fae-6789-4a35-8e4a-47f8d5225ddd admin admin] HTTP exception thrown: Flavor 42 could not be found. May 25 16:13:25.469402 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-88478fae-6789-4a35-8e4a-47f8d5225ddd admin admin] Request method failure captured: May 25 16:13:25.469402 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 25 16:13:25.469402 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: Accept: application/json May 25 16:13:25.469402 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: Accept-Encoding: gzip, deflate May 25 16:13:25.469402 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: Connection: keep-alive May 25 16:13:25.469402 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: Content-Length: 0 May 25 16:13:25.469402 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: Host: 10.222.0.42 May 25 16:13:25.469402 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: Openstack-Api-Version: compute 2.90 May 25 16:13:25.469402 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: Openstack-System-Scope: None May 25 16:13:25.469402 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: User-Agent: python-novaclient May 25 16:13:25.469402 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Auth-Token: gAAAAABijlWllwUfxlonfsSAVeZc6yhsIr3unSUNFPbvD_SYgbsOK3-0JcACf6X31QtWqmECPXnlqn9pyENs4TKmN26_fDokZeq5qhEnFxYINCEClsRrwWjevZNSP2YH4GjYBvd6VZ9hSbRTg42rsvzXFMDZt41ej-sQkU4imuVKQf6sKY3fhEk May 25 16:13:25.469402 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Domain-Id: None May 25 16:13:25.469402 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Domain-Name: None May 25 16:13:25.469402 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Identity-Status: Confirmed May 25 16:13:25.469402 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Is-Admin-Project: True May 25 16:13:25.469402 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Openstack-Nova-Api-Version: 2.90 May 25 16:13:25.469402 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Project-Domain-Id: default May 25 16:13:25.469402 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Project-Domain-Name: Default May 25 16:13:25.469402 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Project-Id: 55f82ef7ffb1469ea7582069b5da4934 May 25 16:13:25.469402 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Project-Name: admin May 25 16:13:25.469402 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Role: reader,member,admin May 25 16:13:25.469402 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Roles: reader,member,admin May 25 16:13:25.470933 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55f82ef7ffb1469ea7582069b5da4934"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/55f82ef7ffb1469ea7582069b5da4934"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_55f82ef7ffb1469ea7582069b5da4934"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55f82ef7ffb1469ea7582069b5da4934"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:13:25.470933 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Tenant: admin May 25 16:13:25.470933 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Tenant-Id: 55f82ef7ffb1469ea7582069b5da4934 May 25 16:13:25.470933 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Tenant-Name: admin May 25 16:13:25.470933 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-User: admin May 25 16:13:25.470933 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-User-Domain-Id: default May 25 16:13:25.470933 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-User-Domain-Name: Default May 25 16:13:25.470933 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-User-Id: cada5de94a8d4bee93afa64a6b5b9d33 May 25 16:13:25.470933 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-User-Name: admin May 25 16:13:25.470933 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: method: > May 25 16:13:25.470933 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: exception: Flavor 42 could not be found. May 25 16:13:25.470933 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: action_args: {'id': '42'} May 25 16:13:25.470933 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:13:25.470933 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:25.471837 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 16:13:25.471837 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 16:13:25.471837 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 16:13:25.471837 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 16:13:25.471837 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 16:13:25.471837 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 16:13:25.471837 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 16:13:25.471837 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 16:13:25.471837 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 16:13:25.471837 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:13:25.471837 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 16:13:25.471837 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 16:13:25.471837 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 25 16:13:25.471837 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi May 25 16:13:25.471837 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:13:25.471837 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi May 25 16:13:25.471837 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:25.471837 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:13:25.471837 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:13:25.472876 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:13:25.472876 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:13:25.472876 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:13:25.472876 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:13:25.472876 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 16:13:25.472876 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 16:13:25.472876 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 25 16:13:25.472876 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi May 25 16:13:25.472876 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:13:25.472876 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi May 25 16:13:25.472876 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:25.472876 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:13:25.472876 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:13:25.472876 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:13:25.472876 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:13:25.472876 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 25 16:13:25.472876 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi May 25 16:13:25.472876 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-88478fae-6789-4a35-8e4a-47f8d5225ddd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:13:25.474347 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-88478fae-6789-4a35-8e4a-47f8d5225ddd admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015569 May 25 16:13:25.474347 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1190 bytes} [Wed May 25 16:13:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 25 16:13:26.362687 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-71b77b4d-80fe-49f9-96d6-d2858638694c admin admin] Calling method '>' {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:26.363704 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-71b77b4d-80fe-49f9-96d6-d2858638694c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 May 25 16:13:26.364092 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1074 bytes} [Wed May 25 16:13:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:13:26.556601 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-b0fc2389-0c50-442d-b6e2-0fdad74e3683 admin admin] Calling method '>' {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:26.562178 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.wsgi [None req-b0fc2389-0c50-442d-b6e2-0fdad74e3683 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 25 16:13:26.564667 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-b0fc2389-0c50-442d-b6e2-0fdad74e3683 admin admin] Request method failure captured: May 25 16:13:26.564667 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 25 16:13:26.564667 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: Accept: application/json May 25 16:13:26.564667 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: Accept-Encoding: gzip, deflate May 25 16:13:26.564667 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: Connection: keep-alive May 25 16:13:26.564667 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: Content-Length: 0 May 25 16:13:26.564667 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: Host: 10.222.0.42 May 25 16:13:26.564667 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: Openstack-Api-Version: compute 2.90 May 25 16:13:26.564667 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: Openstack-System-Scope: None May 25 16:13:26.564667 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: User-Agent: python-novaclient May 25 16:13:26.564667 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Auth-Token: gAAAAABijlWmsYOkx7SoLsgAXt9eK2guE_mXpFQ9T3qv4Rp6KfxwcnBdbuiWgAogMKfswCHhwziT_0MgnI6hqY9gTsRXOXYMUzCVzSsXPMUbcA1tbqwo_WwlSob3B13edNwsVBofYNw_lxr47hL7np5HpAS8JbwPf-uu-R0SnML0I7buofhHdyA May 25 16:13:26.564667 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Domain-Id: None May 25 16:13:26.564667 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Domain-Name: None May 25 16:13:26.564667 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Identity-Status: Confirmed May 25 16:13:26.564667 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Is-Admin-Project: True May 25 16:13:26.564667 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Openstack-Nova-Api-Version: 2.90 May 25 16:13:26.564667 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Project-Domain-Id: default May 25 16:13:26.564667 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Project-Domain-Name: Default May 25 16:13:26.564667 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Project-Id: 55f82ef7ffb1469ea7582069b5da4934 May 25 16:13:26.564667 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Project-Name: admin May 25 16:13:26.564667 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Role: reader,member,admin May 25 16:13:26.564667 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Roles: reader,member,admin May 25 16:13:26.566106 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55f82ef7ffb1469ea7582069b5da4934"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/55f82ef7ffb1469ea7582069b5da4934"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_55f82ef7ffb1469ea7582069b5da4934"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55f82ef7ffb1469ea7582069b5da4934"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:13:26.566106 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Tenant: admin May 25 16:13:26.566106 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Tenant-Id: 55f82ef7ffb1469ea7582069b5da4934 May 25 16:13:26.566106 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Tenant-Name: admin May 25 16:13:26.566106 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-User: admin May 25 16:13:26.566106 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-User-Domain-Id: default May 25 16:13:26.566106 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-User-Domain-Name: Default May 25 16:13:26.566106 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-User-Id: cada5de94a8d4bee93afa64a6b5b9d33 May 25 16:13:26.566106 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-User-Name: admin May 25 16:13:26.566106 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: method: > May 25 16:13:26.566106 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: exception: Flavor 84 could not be found. May 25 16:13:26.566106 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: action_args: {'id': '84'} May 25 16:13:26.566106 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:13:26.566106 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:26.566923 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 16:13:26.566923 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 16:13:26.566923 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 16:13:26.566923 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 16:13:26.566923 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 16:13:26.566923 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 16:13:26.566923 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 16:13:26.566923 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 16:13:26.566923 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 16:13:26.566923 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:13:26.566923 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 16:13:26.566923 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 16:13:26.566923 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 25 16:13:26.566923 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi May 25 16:13:26.566923 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:13:26.566923 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi May 25 16:13:26.566923 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:26.566923 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:13:26.566923 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:13:26.568010 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:13:26.568010 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:13:26.568010 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:13:26.568010 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:13:26.568010 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 16:13:26.568010 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 16:13:26.568010 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 25 16:13:26.568010 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi May 25 16:13:26.568010 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:13:26.568010 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi May 25 16:13:26.568010 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:26.568010 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:13:26.568010 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:13:26.568010 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:13:26.568010 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:13:26.568010 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 25 16:13:26.568010 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi May 25 16:13:26.568010 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-b0fc2389-0c50-442d-b6e2-0fdad74e3683 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:13:26.569053 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-b0fc2389-0c50-442d-b6e2-0fdad74e3683 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.062423 May 25 16:13:26.569053 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1190 bytes} [Wed May 25 16:13:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 16:13:26.575947 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-824294cb-ae67-4448-94b8-f23d4a8d0fbf admin admin] Calling method '>' {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:26.592282 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-824294cb-ae67-4448-94b8-f23d4a8d0fbf admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019850 May 25 16:13:26.592853 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1210 bytes} [Wed May 25 16:13:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:13:26.605815 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-40b29c7b-04c6-4d39-b0eb-2c59a42da2d9 admin admin] Calling method '>' {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:26.621138 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-40b29c7b-04c6-4d39-b0eb-2c59a42da2d9 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021353 May 25 16:13:26.621695 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1210 bytes} [Wed May 25 16:13:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:26.631939 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-b913a112-7e15-4769-aca6-d57513e69431 admin admin] Calling method '>' {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:26.637651 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.wsgi [None req-b913a112-7e15-4769-aca6-d57513e69431 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 25 16:13:26.639226 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-b913a112-7e15-4769-aca6-d57513e69431 admin admin] Request method failure captured: May 25 16:13:26.639226 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 25 16:13:26.639226 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: Accept: application/json May 25 16:13:26.639226 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: Accept-Encoding: gzip, deflate May 25 16:13:26.639226 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: Connection: keep-alive May 25 16:13:26.639226 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: Content-Length: 0 May 25 16:13:26.639226 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: Host: 10.222.0.42 May 25 16:13:26.639226 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: Openstack-Api-Version: compute 2.90 May 25 16:13:26.639226 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: Openstack-System-Scope: None May 25 16:13:26.639226 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: User-Agent: python-novaclient May 25 16:13:26.639226 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Auth-Token: gAAAAABijlWmsYOkx7SoLsgAXt9eK2guE_mXpFQ9T3qv4Rp6KfxwcnBdbuiWgAogMKfswCHhwziT_0MgnI6hqY9gTsRXOXYMUzCVzSsXPMUbcA1tbqwo_WwlSob3B13edNwsVBofYNw_lxr47hL7np5HpAS8JbwPf-uu-R0SnML0I7buofhHdyA May 25 16:13:26.639226 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Domain-Id: None May 25 16:13:26.639226 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Domain-Name: None May 25 16:13:26.639226 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Identity-Status: Confirmed May 25 16:13:26.639226 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Is-Admin-Project: True May 25 16:13:26.639226 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Openstack-Nova-Api-Version: 2.90 May 25 16:13:26.639226 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Project-Domain-Id: default May 25 16:13:26.639226 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Project-Domain-Name: Default May 25 16:13:26.639226 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Project-Id: 55f82ef7ffb1469ea7582069b5da4934 May 25 16:13:26.639226 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Project-Name: admin May 25 16:13:26.639226 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Role: reader,member,admin May 25 16:13:26.639226 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Roles: reader,member,admin May 25 16:13:26.641612 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55f82ef7ffb1469ea7582069b5da4934"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/55f82ef7ffb1469ea7582069b5da4934"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_55f82ef7ffb1469ea7582069b5da4934"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55f82ef7ffb1469ea7582069b5da4934"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:13:26.641612 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Tenant: admin May 25 16:13:26.641612 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Tenant-Id: 55f82ef7ffb1469ea7582069b5da4934 May 25 16:13:26.641612 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Tenant-Name: admin May 25 16:13:26.641612 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-User: admin May 25 16:13:26.641612 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-User-Domain-Id: default May 25 16:13:26.641612 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-User-Domain-Name: Default May 25 16:13:26.641612 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-User-Id: cada5de94a8d4bee93afa64a6b5b9d33 May 25 16:13:26.641612 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-User-Name: admin May 25 16:13:26.641612 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: method: > May 25 16:13:26.641612 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: exception: Flavor 84 could not be found. May 25 16:13:26.641612 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: action_args: {'id': '84'} May 25 16:13:26.641612 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:13:26.641612 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:26.643013 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 16:13:26.643013 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 16:13:26.643013 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 16:13:26.643013 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 16:13:26.643013 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 16:13:26.643013 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 16:13:26.643013 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 16:13:26.643013 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 16:13:26.643013 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 16:13:26.643013 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:13:26.643013 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 16:13:26.643013 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 16:13:26.643013 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 25 16:13:26.643013 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi May 25 16:13:26.643013 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:13:26.643013 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi May 25 16:13:26.643013 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:26.643013 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:13:26.643013 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:13:26.644356 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:13:26.644356 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:13:26.644356 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:13:26.644356 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:13:26.644356 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 16:13:26.644356 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 16:13:26.644356 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 25 16:13:26.644356 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi May 25 16:13:26.644356 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:13:26.644356 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi May 25 16:13:26.644356 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:26.644356 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:13:26.644356 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:13:26.644356 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:13:26.644356 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:13:26.644356 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 25 16:13:26.644356 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi May 25 16:13:26.644356 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-b913a112-7e15-4769-aca6-d57513e69431 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:13:26.646006 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-b913a112-7e15-4769-aca6-d57513e69431 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012913 May 25 16:13:26.646006 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1190 bytes} [Wed May 25 16:13:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 16:13:27.578283 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-40b29c7b-04c6-4d39-b0eb-2c59a42da2d9 admin admin] Calling method '>' {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:27.579322 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-40b29c7b-04c6-4d39-b0eb-2c59a42da2d9 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001603 May 25 16:13:27.579716 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1074 bytes} [Wed May 25 16:13:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:13:27.771654 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-1d45babf-68a4-406e-a3e9-3746d7cdbda2 admin admin] Calling method '>' {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:27.777481 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.wsgi [None req-1d45babf-68a4-406e-a3e9-3746d7cdbda2 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 25 16:13:27.779017 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-1d45babf-68a4-406e-a3e9-3746d7cdbda2 admin admin] Request method failure captured: May 25 16:13:27.779017 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 25 16:13:27.779017 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: Accept: application/json May 25 16:13:27.779017 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: Accept-Encoding: gzip, deflate May 25 16:13:27.779017 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: Connection: keep-alive May 25 16:13:27.779017 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: Content-Length: 0 May 25 16:13:27.779017 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: Host: 10.222.0.42 May 25 16:13:27.779017 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: Openstack-Api-Version: compute 2.90 May 25 16:13:27.779017 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: Openstack-System-Scope: None May 25 16:13:27.779017 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: User-Agent: python-novaclient May 25 16:13:27.779017 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Auth-Token: gAAAAABijlWnU3sj_a31AXm-tDMtUPf1goawf9RLPVgyXcl5CRyZd-QPg2KX9gBvNiw-h8EK-AwT_mxikALpg0eEnk8N91h8bYpu9WjPpwk0Jd-jeOgaI1ngfaOc1Qx0LJa2L2qy5oYo4Xg2gekhVZvfHaunQjHWQX6AYT23GeQamw5578OsMiY May 25 16:13:27.779017 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Domain-Id: None May 25 16:13:27.779017 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Domain-Name: None May 25 16:13:27.779017 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Identity-Status: Confirmed May 25 16:13:27.779017 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Is-Admin-Project: True May 25 16:13:27.779017 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Openstack-Nova-Api-Version: 2.90 May 25 16:13:27.779017 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Project-Domain-Id: default May 25 16:13:27.779017 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Project-Domain-Name: Default May 25 16:13:27.779017 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Project-Id: 55f82ef7ffb1469ea7582069b5da4934 May 25 16:13:27.779017 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Project-Name: admin May 25 16:13:27.779017 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Role: reader,member,admin May 25 16:13:27.779017 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Roles: reader,member,admin May 25 16:13:27.780544 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55f82ef7ffb1469ea7582069b5da4934"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/55f82ef7ffb1469ea7582069b5da4934"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_55f82ef7ffb1469ea7582069b5da4934"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55f82ef7ffb1469ea7582069b5da4934"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:13:27.780544 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Tenant: admin May 25 16:13:27.780544 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Tenant-Id: 55f82ef7ffb1469ea7582069b5da4934 May 25 16:13:27.780544 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-Tenant-Name: admin May 25 16:13:27.780544 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-User: admin May 25 16:13:27.780544 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-User-Domain-Id: default May 25 16:13:27.780544 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-User-Domain-Name: Default May 25 16:13:27.780544 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-User-Id: cada5de94a8d4bee93afa64a6b5b9d33 May 25 16:13:27.780544 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: X-User-Name: admin May 25 16:13:27.780544 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: method: > May 25 16:13:27.780544 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: exception: Flavor 451 could not be found. May 25 16:13:27.780544 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: action_args: {'id': '451'} May 25 16:13:27.780544 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:13:27.780544 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:27.782210 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 16:13:27.782210 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 16:13:27.782210 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 16:13:27.782210 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 16:13:27.782210 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 16:13:27.782210 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 16:13:27.782210 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 16:13:27.782210 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 16:13:27.782210 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 16:13:27.782210 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:13:27.782210 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 16:13:27.782210 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 16:13:27.782210 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 25 16:13:27.782210 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi May 25 16:13:27.782210 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:13:27.782210 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi May 25 16:13:27.782210 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:27.782210 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:13:27.782210 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:13:27.783573 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:13:27.783573 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:13:27.783573 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:13:27.783573 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:13:27.783573 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 16:13:27.783573 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 16:13:27.783573 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 25 16:13:27.783573 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi May 25 16:13:27.783573 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:13:27.783573 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi May 25 16:13:27.783573 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:27.783573 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:13:27.783573 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:13:27.783573 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:13:27.783573 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:13:27.783573 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 25 16:13:27.783573 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: ERROR nova.api.openstack.wsgi May 25 16:13:27.783573 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-1d45babf-68a4-406e-a3e9-3746d7cdbda2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:13:27.785266 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-1d45babf-68a4-406e-a3e9-3746d7cdbda2 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060091 May 25 16:13:27.785266 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1193 bytes} [Wed May 25 16:13:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 16:13:27.791462 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-966454ca-288d-4bdd-83ba-9b4f5fcbe880 admin admin] Calling method '>' {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:27.805153 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-966454ca-288d-4bdd-83ba-9b4f5fcbe880 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017344 May 25 16:13:27.805682 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1210 bytes} [Wed May 25 16:13:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:27.815463 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-41ff6a85-6847-44fe-951b-f7144f9778c7 admin admin] Calling method '>' {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:27.829526 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-41ff6a85-6847-44fe-951b-f7144f9778c7 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017732 May 25 16:13:27.830093 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1210 bytes} [Wed May 25 16:13:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:27.839373 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-3a77c401-dc7c-4271-bd1e-dcc33b330213 admin admin] Calling method '>' {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:27.844884 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.wsgi [None req-3a77c401-dc7c-4271-bd1e-dcc33b330213 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 25 16:13:27.846487 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-3a77c401-dc7c-4271-bd1e-dcc33b330213 admin admin] Request method failure captured: May 25 16:13:27.846487 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 25 16:13:27.846487 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: Accept: application/json May 25 16:13:27.846487 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: Accept-Encoding: gzip, deflate May 25 16:13:27.846487 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: Connection: keep-alive May 25 16:13:27.846487 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: Content-Length: 0 May 25 16:13:27.846487 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: Host: 10.222.0.42 May 25 16:13:27.846487 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: Openstack-Api-Version: compute 2.90 May 25 16:13:27.846487 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: Openstack-System-Scope: None May 25 16:13:27.846487 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: User-Agent: python-novaclient May 25 16:13:27.846487 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Auth-Token: gAAAAABijlWnU3sj_a31AXm-tDMtUPf1goawf9RLPVgyXcl5CRyZd-QPg2KX9gBvNiw-h8EK-AwT_mxikALpg0eEnk8N91h8bYpu9WjPpwk0Jd-jeOgaI1ngfaOc1Qx0LJa2L2qy5oYo4Xg2gekhVZvfHaunQjHWQX6AYT23GeQamw5578OsMiY May 25 16:13:27.846487 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Domain-Id: None May 25 16:13:27.846487 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Domain-Name: None May 25 16:13:27.846487 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Identity-Status: Confirmed May 25 16:13:27.846487 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Is-Admin-Project: True May 25 16:13:27.846487 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Openstack-Nova-Api-Version: 2.90 May 25 16:13:27.846487 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Project-Domain-Id: default May 25 16:13:27.846487 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Project-Domain-Name: Default May 25 16:13:27.846487 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Project-Id: 55f82ef7ffb1469ea7582069b5da4934 May 25 16:13:27.846487 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Project-Name: admin May 25 16:13:27.846487 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Role: reader,member,admin May 25 16:13:27.846487 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Roles: reader,member,admin May 25 16:13:27.848064 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55f82ef7ffb1469ea7582069b5da4934"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/55f82ef7ffb1469ea7582069b5da4934"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_55f82ef7ffb1469ea7582069b5da4934"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55f82ef7ffb1469ea7582069b5da4934"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:13:27.848064 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Tenant: admin May 25 16:13:27.848064 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Tenant-Id: 55f82ef7ffb1469ea7582069b5da4934 May 25 16:13:27.848064 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-Tenant-Name: admin May 25 16:13:27.848064 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-User: admin May 25 16:13:27.848064 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-User-Domain-Id: default May 25 16:13:27.848064 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-User-Domain-Name: Default May 25 16:13:27.848064 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-User-Id: cada5de94a8d4bee93afa64a6b5b9d33 May 25 16:13:27.848064 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: X-User-Name: admin May 25 16:13:27.848064 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: method: > May 25 16:13:27.848064 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: exception: Flavor 451 could not be found. May 25 16:13:27.848064 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: action_args: {'id': '451'} May 25 16:13:27.848064 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:13:27.848064 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:27.848930 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 16:13:27.848930 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 16:13:27.848930 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 16:13:27.848930 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 16:13:27.848930 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 16:13:27.848930 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 16:13:27.848930 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 16:13:27.848930 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 16:13:27.848930 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 16:13:27.848930 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:13:27.848930 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 16:13:27.848930 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 16:13:27.848930 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 25 16:13:27.848930 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi May 25 16:13:27.848930 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:13:27.848930 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi May 25 16:13:27.848930 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:27.848930 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:13:27.848930 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:13:27.850651 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:13:27.850651 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:13:27.850651 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:13:27.850651 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:13:27.850651 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 16:13:27.850651 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 16:13:27.850651 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 25 16:13:27.850651 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi May 25 16:13:27.850651 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:13:27.850651 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi May 25 16:13:27.850651 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:27.850651 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:13:27.850651 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:13:27.850651 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:13:27.850651 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:13:27.850651 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 25 16:13:27.850651 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: ERROR nova.api.openstack.wsgi May 25 16:13:27.850651 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-3a77c401-dc7c-4271-bd1e-dcc33b330213 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:13:27.851871 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-3a77c401-dc7c-4271-bd1e-dcc33b330213 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012011 May 25 16:13:27.851871 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1193 bytes} [Wed May 25 16:13:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 25 16:13:28.728478 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-41ff6a85-6847-44fe-951b-f7144f9778c7 admin admin] Calling method '>' {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:28.729497 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-41ff6a85-6847-44fe-951b-f7144f9778c7 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 May 25 16:13:28.729921 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1074 bytes} [Wed May 25 16:13:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:13:28.924424 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-0365b273-554a-4d51-9c55-2daaf4241d7a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:13:28.944031 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-0365b273-554a-4d51-9c55-2daaf4241d7a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.072054 May 25 16:13:28.944521 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1235 bytes} [Wed May 25 16:13:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:13:29.827377 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-41ff6a85-6847-44fe-951b-f7144f9778c7 admin admin] Calling method '>' {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:29.828968 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-41ff6a85-6847-44fe-951b-f7144f9778c7 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002011 May 25 16:13:29.829355 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1074 bytes} [Wed May 25 16:13:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:13:30.024368 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-22c19d75-9457-431e-8ef1-7febd5173fd2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:13:30.044012 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-22c19d75-9457-431e-8ef1-7febd5173fd2 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.076363 May 25 16:13:30.044692 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1235 bytes} [Wed May 25 16:13:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:13:30.943197 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-41ff6a85-6847-44fe-951b-f7144f9778c7 admin admin] Calling method '>' {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:30.944198 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-41ff6a85-6847-44fe-951b-f7144f9778c7 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 May 25 16:13:30.944593 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1074 bytes} [Wed May 25 16:13:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:13:31.138815 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-e1e57c6d-0eaf-4e57-a3e6-3d0c770ee5d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:13:31.157696 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-e1e57c6d-0eaf-4e57-a3e6-3d0c770ee5d5 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070553 May 25 16:13:31.158208 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1235 bytes} [Wed May 25 16:13:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:13:32.036638 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-41ff6a85-6847-44fe-951b-f7144f9778c7 admin admin] Calling method '>' {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:32.037673 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-41ff6a85-6847-44fe-951b-f7144f9778c7 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 25 16:13:32.038119 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1074 bytes} [Wed May 25 16:13:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:13:32.232757 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-aa4289b2-f61b-4f51-8baf-bec438b0a4c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:13:32.251305 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-aa4289b2-f61b-4f51-8baf-bec438b0a4c9 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.073317 May 25 16:13:32.251847 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1235 bytes} [Wed May 25 16:13:32 2022] POST /compute/v2.1/flavors => generated 409 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:13:33.126728 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-41ff6a85-6847-44fe-951b-f7144f9778c7 admin admin] Calling method '>' {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:33.127739 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-41ff6a85-6847-44fe-951b-f7144f9778c7 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 May 25 16:13:33.128149 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1074 bytes} [Wed May 25 16:13:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:13:33.318396 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-ed30f6df-a2fc-4271-a776-5d7bbe1cddcf admin admin] Calling method '>' {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:33.337920 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-ed30f6df-a2fc-4271-a776-5d7bbe1cddcf admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073850 May 25 16:13:33.338380 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1202 bytes} [Wed May 25 16:13:33 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:14:36.626376 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-41ff6a85-6847-44fe-951b-f7144f9778c7 admin admin] Calling method '>' {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:36.627456 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-41ff6a85-6847-44fe-951b-f7144f9778c7 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 May 25 16:14:36.627855 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 31/63] 10.222.0.42 () {54 vars in 930 bytes} [Wed May 25 16:14:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:14:36.639325 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG dbcounter [-] [103073] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:14:36.689447 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-b800e431-9d8f-49c5-97b7-623e6696c80f admin admin] Calling method '>' {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:36.709242 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-b800e431-9d8f-49c5-97b7-623e6696c80f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075518 May 25 16:14:36.709789 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1291 bytes} [Wed May 25 16:14:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:14:36.730522 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG dbcounter [-] [103074] Writing DB stats nova_api:SELECT=14 {{(pid=103074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:14:36.734997 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-0f1709a4-be76-44e8-983a-7882c612ca48 admin admin] Calling method '>' {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:36.742495 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-0f1709a4-be76-44e8-983a-7882c612ca48 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013449 May 25 16:14:36.743013 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1282 bytes} [Wed May 25 16:14:36 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:14:36.755124 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-7f4499f5-725b-44b8-a68f-7ebd02c789ea admin admin] Calling method '>' {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:36.762670 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-7f4499f5-725b-44b8-a68f-7ebd02c789ea admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011175 May 25 16:14:36.763169 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1285 bytes} [Wed May 25 16:14:36 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:14:36.774358 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-6da9ad00-1f11-48b2-8fc4-6afe8f0a06a9 admin admin] Calling method '>' {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:36.782331 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-6da9ad00-1f11-48b2-8fc4-6afe8f0a06a9 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011446 May 25 16:14:36.782862 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1285 bytes} [Wed May 25 16:14:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:14:36.796089 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-cefe5485-53ac-4214-8a94-4f7598d806f4 admin admin] Calling method '>' {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:36.803819 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-cefe5485-53ac-4214-8a94-4f7598d806f4 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011974 May 25 16:14:36.804315 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 35/68] 10.222.0.42 () {60 vars in 1282 bytes} [Wed May 25 16:14:36 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:18:15.328821 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-6da9ad00-1f11-48b2-8fc4-6afe8f0a06a9 admin admin] Calling method '>' {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:15.329855 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-6da9ad00-1f11-48b2-8fc4-6afe8f0a06a9 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 25 16:18:15.330254 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1074 bytes} [Wed May 25 16:18:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:18:15.489489 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG dbcounter [-] [103073] Writing DB stats nova_api:SELECT=6 {{(pid=103073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:15.602495 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-79b01042-a7e0-4d77-9d2a-847a5eb85e73 admin admin] Calling method '>' {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:15.603665 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 16:18:15.603665 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: warnings.warn(msg) May 25 16:18:15.604887 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG oslo_concurrency.lockutils [None req-79b01042-a7e0-4d77-9d2a-847a5eb85e73 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:15.605329 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG oslo_concurrency.lockutils [None req-79b01042-a7e0-4d77-9d2a-847a5eb85e73 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:15.606142 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG oslo_concurrency.lockutils [None req-79b01042-a7e0-4d77-9d2a-847a5eb85e73 admin admin] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:15.606588 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG oslo_concurrency.lockutils [None req-79b01042-a7e0-4d77-9d2a-847a5eb85e73 admin admin] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:15.640677 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-79b01042-a7e0-4d77-9d2a-847a5eb85e73 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.156336 May 25 16:18:15.641257 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 36/70] 10.222.0.42 () {60 vars in 1193 bytes} [Wed May 25 16:18:15 2022] GET /compute/v2.1/os-services => generated 791 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:18:16.532323 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-6da9ad00-1f11-48b2-8fc4-6afe8f0a06a9 admin admin] Calling method '>' {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:16.533329 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-6da9ad00-1f11-48b2-8fc4-6afe8f0a06a9 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 May 25 16:18:16.533738 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1074 bytes} [Wed May 25 16:18:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:18:16.727518 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-2f931f93-e325-4587-b6a2-2042e642db0c admin admin] Calling method '>' {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:16.728699 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 16:18:16.728699 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: warnings.warn(msg) May 25 16:18:16.729929 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG oslo_concurrency.lockutils [None req-2f931f93-e325-4587-b6a2-2042e642db0c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:16.730376 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG oslo_concurrency.lockutils [None req-2f931f93-e325-4587-b6a2-2042e642db0c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:16.731161 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG oslo_concurrency.lockutils [None req-2f931f93-e325-4587-b6a2-2042e642db0c admin admin] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:16.731687 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG oslo_concurrency.lockutils [None req-2f931f93-e325-4587-b6a2-2042e642db0c admin admin] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:16.751404 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-2f931f93-e325-4587-b6a2-2042e642db0c admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077645 May 25 16:18:16.751942 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 37/72] 10.222.0.42 () {60 vars in 1193 bytes} [Wed May 25 16:18:16 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:18:28.064571 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-6da9ad00-1f11-48b2-8fc4-6afe8f0a06a9 admin admin] Calling method '>' {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:28.065577 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-6da9ad00-1f11-48b2-8fc4-6afe8f0a06a9 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 May 25 16:18:28.066186 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1074 bytes} [Wed May 25 16:18:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:18:28.208630 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG dbcounter [-] [103073] Writing DB stats nova_cell0:SELECT=4 {{(pid=103073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:28.209431 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG dbcounter [-] [103073] Writing DB stats nova_cell1:SELECT=4 {{(pid=103073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:28.210179 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG dbcounter [-] [103073] Writing DB stats nova_api:SELECT=8 {{(pid=103073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:28.257634 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-5e7fc1ce-ff22-4244-8435-042060d1ff79 admin admin] Calling method '>' {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:28.258833 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 16:18:28.258833 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: warnings.warn(msg) May 25 16:18:28.260023 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG oslo_concurrency.lockutils [None req-5e7fc1ce-ff22-4244-8435-042060d1ff79 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:28.260464 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG oslo_concurrency.lockutils [None req-5e7fc1ce-ff22-4244-8435-042060d1ff79 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:28.261281 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG oslo_concurrency.lockutils [None req-5e7fc1ce-ff22-4244-8435-042060d1ff79 admin admin] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:28.261731 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG oslo_concurrency.lockutils [None req-5e7fc1ce-ff22-4244-8435-042060d1ff79 admin admin] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:28.287126 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-5e7fc1ce-ff22-4244-8435-042060d1ff79 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082809 May 25 16:18:28.287601 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 38/74] 10.222.0.42 () {60 vars in 1193 bytes} [Wed May 25 16:18:28 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:18:29.179605 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: DEBUG nova.api.openstack.wsgi [None req-6da9ad00-1f11-48b2-8fc4-6afe8f0a06a9 admin admin] Calling method '>' {{(pid=103074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:29.180611 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: INFO nova.api.openstack.requestlog [None req-6da9ad00-1f11-48b2-8fc4-6afe8f0a06a9 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 May 25 16:18:29.181008 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: [pid: 103074|app: 0|req: 37/75] 10.222.0.42 () {56 vars in 1074 bytes} [Wed May 25 16:18:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:18:29.377149 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG nova.api.openstack.wsgi [None req-56eebadc-28bb-49c0-943e-41a8e0efa5fa admin admin] Calling method '>' {{(pid=103073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:29.378349 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 16:18:29.378349 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: warnings.warn(msg) May 25 16:18:29.379531 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG oslo_concurrency.lockutils [None req-56eebadc-28bb-49c0-943e-41a8e0efa5fa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:29.379981 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG oslo_concurrency.lockutils [None req-56eebadc-28bb-49c0-943e-41a8e0efa5fa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:29.380760 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG oslo_concurrency.lockutils [None req-56eebadc-28bb-49c0-943e-41a8e0efa5fa admin admin] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:29.381186 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: DEBUG oslo_concurrency.lockutils [None req-56eebadc-28bb-49c0-943e-41a8e0efa5fa admin admin] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:29.403745 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: INFO nova.api.openstack.requestlog [None req-56eebadc-28bb-49c0-943e-41a8e0efa5fa admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076590 May 25 16:18:29.404303 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: [pid: 103073|app: 0|req: 39/76] 10.222.0.42 () {60 vars in 1193 bytes} [Wed May 25 16:18:29 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:19:28.938666 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: Wed May 25 16:19:28 2022 - graceful shutdown triggered... May 25 16:19:28.938803 dv-cinder-843278-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 25 16:19:28.939772 dv-cinder-843278-2-iscsi devstack@n-api.service[103073]: Gracefully killing worker 1 (pid: 103073)... May 25 16:19:28.940177 dv-cinder-843278-2-iscsi devstack@n-api.service[103074]: Gracefully killing worker 2 (pid: 103074)... May 25 16:19:29.940860 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: worker 1 buried after 1 seconds May 25 16:19:29.940860 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: worker 2 buried after 1 seconds May 25 16:19:29.940860 dv-cinder-843278-2-iscsi devstack@n-api.service[103072]: goodbye to uWSGI. May 25 16:19:29.942420 dv-cinder-843278-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 25 16:19:29.942998 dv-cinder-843278-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 25 16:19:29.945745 dv-cinder-843278-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 25 16:19:29.962899 dv-cinder-843278-2-iscsi devstack@n-api.service[117498]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 25 16:19:29.982882 dv-cinder-843278-2-iscsi devstack@n-api.service[117498]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 25 16:19:29 2022] *** May 25 16:19:29.982882 dv-cinder-843278-2-iscsi devstack@n-api.service[117498]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 25 16:19:29.982882 dv-cinder-843278-2-iscsi devstack@n-api.service[117498]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 25 16:19:29.982882 dv-cinder-843278-2-iscsi devstack@n-api.service[117498]: nodename: dv-cinder-843278-2-iscsi May 25 16:19:29.982882 dv-cinder-843278-2-iscsi devstack@n-api.service[117498]: machine: x86_64 May 25 16:19:29.982882 dv-cinder-843278-2-iscsi devstack@n-api.service[117498]: clock source: unix May 25 16:19:29.982882 dv-cinder-843278-2-iscsi devstack@n-api.service[117498]: pcre jit disabled May 25 16:19:29.982882 dv-cinder-843278-2-iscsi devstack@n-api.service[117498]: detected number of CPU cores: 4 May 25 16:19:29.982882 dv-cinder-843278-2-iscsi devstack@n-api.service[117498]: current working directory: / May 25 16:19:29.982882 dv-cinder-843278-2-iscsi devstack@n-api.service[117498]: detected binary path: /usr/bin/uwsgi-core May 25 16:19:29.982882 dv-cinder-843278-2-iscsi devstack@n-api.service[117498]: your processes number limit is 47680 May 25 16:19:29.983731 dv-cinder-843278-2-iscsi devstack@n-api.service[117498]: your memory page size is 4096 bytes May 25 16:19:29.983731 dv-cinder-843278-2-iscsi devstack@n-api.service[117498]: detected max file descriptor number: 2048 May 25 16:19:29.983731 dv-cinder-843278-2-iscsi devstack@n-api.service[117498]: lock engine: pthread robust mutexes May 25 16:19:29.983731 dv-cinder-843278-2-iscsi devstack@n-api.service[117498]: thunder lock: enabled May 25 16:19:29.983731 dv-cinder-843278-2-iscsi devstack@n-api.service[117498]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 25 16:19:29.983731 dv-cinder-843278-2-iscsi devstack@n-api.service[117498]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 25 16:19:30.029882 dv-cinder-843278-2-iscsi devstack@n-api.service[117498]: Python main interpreter initialized at 0x55aeeecc49c0 May 25 16:19:30.029882 dv-cinder-843278-2-iscsi devstack@n-api.service[117498]: python threads support enabled May 25 16:19:30.029882 dv-cinder-843278-2-iscsi devstack@n-api.service[117498]: your server socket listen backlog is limited to 100 connections May 25 16:19:30.029882 dv-cinder-843278-2-iscsi devstack@n-api.service[117498]: your mercy for graceful operations on workers is 90 seconds May 25 16:19:30.030332 dv-cinder-843278-2-iscsi devstack@n-api.service[117498]: mapped 403077 bytes (393 KB) for 2 cores May 25 16:19:30.030332 dv-cinder-843278-2-iscsi devstack@n-api.service[117498]: *** Operational MODE: preforking *** May 25 16:19:30.030563 dv-cinder-843278-2-iscsi devstack@n-api.service[117498]: *** uWSGI is running in multiple interpreter mode *** May 25 16:19:30.030563 dv-cinder-843278-2-iscsi devstack@n-api.service[117498]: spawned uWSGI master process (pid: 117498) May 25 16:19:30.030768 dv-cinder-843278-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 25 16:19:30.031463 dv-cinder-843278-2-iscsi devstack@n-api.service[117498]: spawned uWSGI worker 1 (pid: 117509, cores: 1) May 25 16:19:30.034615 dv-cinder-843278-2-iscsi devstack@n-api.service[117498]: spawned uWSGI worker 2 (pid: 117510, cores: 1) May 25 16:19:30.034615 dv-cinder-843278-2-iscsi devstack@n-api.service[117498]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 25 16:19:31.227909 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 25 16:19:31.228895 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 25 16:19:32.052540 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 16:19:32.052540 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: from cryptography.utils import int_from_bytes May 25 16:19:32.052883 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 16:19:32.052883 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: from cryptography.utils import int_from_bytes May 25 16:19:32.053413 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 16:19:32.053413 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: from cryptography.utils import int_from_bytes May 25 16:19:32.053768 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 16:19:32.053768 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: from cryptography.utils import int_from_bytes May 25 16:19:34.505241 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 16:19:34.505795 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 16:19:34.506040 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 16:19:34.506343 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 16:19:34.506602 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 16:19:34.506996 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.507326 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.507651 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.508007 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.508344 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.508660 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.508984 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.509308 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.509639 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.509928 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.510251 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.510581 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843278-2-iscsi {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.510913 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.511224 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.511540 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.511917 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.512227 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.512553 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.512867 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.513371 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.514893 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.514893 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.514893 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.514893 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.515232 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.515450 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.515678 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.515998 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.516325 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.516632 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.517028 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843278-2-iscsi {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.517354 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.517670 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.518015 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.518440 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.518756 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.519079 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.519394 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.519721 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.520028 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.520354 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.520681 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.521000 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.521323 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.521638 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.521961 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.522279 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.522604 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.522913 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.523223 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.523473 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.523782 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.524106 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.524426 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.524949 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.525210 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.525464 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.525809 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.526138 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.526449 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.526783 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.527063 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.527407 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.527720 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.528028 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.528336 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.528642 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.528961 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.529279 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.529600 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.530447 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.530777 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.531215 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.531625 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.532118 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.532469 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.532791 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.533103 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.533427 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.533771 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.534086 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.534399 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.534708 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.535036 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.535364 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.535671 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.535925 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.536239 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.536543 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.536864 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.537171 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.537477 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.538067 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.538379 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.538687 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.538990 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.539298 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.539604 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.539910 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.540217 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.540526 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.540836 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.541148 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.541466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.541819 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.542129 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.542435 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.542749 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.543680 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.543911 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.544221 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.544526 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.544853 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.545167 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.545477 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.545825 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.546140 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.546451 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.546773 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.547075 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.547383 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.547701 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.548010 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.548319 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.548626 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.548933 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.549241 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.549547 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.549881 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.550191 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.550495 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.550816 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.551145 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.551460 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.551763 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.552071 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.552392 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.552745 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.553072 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.553414 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.553746 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.554090 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.554422 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.554744 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.555064 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.555382 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.555710 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.556024 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.556339 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.556658 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.556984 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.557297 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.557630 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.557984 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.558306 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.559318 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.559586 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.560018 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.560361 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.560692 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.561007 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.561357 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.561706 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.562043 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.562372 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.562477 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 16:19:34.562925 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 16:19:34.563029 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.563029 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.563202 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 16:19:34.563294 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.563519 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 16:19:34.563628 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.563726 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 16:19:34.563915 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.564116 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.564252 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.564441 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.564567 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.564761 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.564889 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.565079 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.565190 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.565408 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.565514 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.565816 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.565928 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.566211 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.566321 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.566417 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.566504 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.566683 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.566790 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.567452 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.567583 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.567675 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.567769 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.567868 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843278-2-iscsi {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.567963 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.568059 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.568147 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.568232 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.568324 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.568442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.568584 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.568757 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.568897 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.569061 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.569206 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.569382 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.569515 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.569687 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.569838 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.570157 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.570263 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.570870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.571002 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.571104 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.571200 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.571200 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.571403 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.571403 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.571570 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.571803 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.571918 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.572014 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.572095 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.572305 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.572410 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.572610 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.572701 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.572975 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.573133 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.573291 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.573453 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.573802 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.573992 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843278-2-iscsi {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.574219 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.574531 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.574693 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.574854 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.575027 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.575182 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.575334 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.575547 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.575716 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.576624 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.576827 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.576990 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.577543 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.577742 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.577919 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.578085 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.578256 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.578422 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.578587 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.578741 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.578901 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.578901 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.579208 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.579374 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.579541 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.579696 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.579848 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.580008 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.580161 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.580326 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.580488 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.580488 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.580826 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.580993 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.581155 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.581315 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.581483 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.581637 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.581856 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.582150 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.582312 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.582482 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.582657 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.582818 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.582980 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.583133 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.583292 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.583456 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.583622 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.583945 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.584110 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.584264 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.584454 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.584686 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.584857 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.585019 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.585174 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.585333 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.585502 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.585668 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.585849 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.586031 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.586285 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.586452 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.586617 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.586771 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.586935 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.587088 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.587269 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.587573 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.587573 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.587992 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.587992 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.588302 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.588463 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.588617 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.588617 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.588915 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.589077 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.589263 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.589536 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.589811 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.589811 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.590138 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.590138 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.590437 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.590590 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.590744 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.590911 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.591076 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.591240 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.591395 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.591557 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.591709 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.591877 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.592031 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.592341 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.592505 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.592660 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.592812 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.592975 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.594462 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.594674 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.594923 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.595123 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.595289 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.595289 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.595580 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.595748 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.595910 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.596074 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.596228 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.596503 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.596664 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.596829 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.598519 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.598758 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.598925 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.598925 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.599225 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.599397 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.599563 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.599725 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.599878 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.600031 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.600197 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.600358 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.600511 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.600686 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.600849 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.601003 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.601170 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.601333 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.601486 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.601645 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.601863 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.602092 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.602490 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.602654 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.602808 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.602967 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.603135 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.603296 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.603461 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.603622 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.603795 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.604188 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.604368 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.604524 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.604686 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.604840 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.605094 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.605255 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.606060 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.606354 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.606773 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.607020 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.607293 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.607990 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.608416 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.608683 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.609165 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.609433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.609848 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.610128 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.610389 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.610647 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.610925 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.611198 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.611198 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.611569 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.611726 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.611889 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.612051 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.612212 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.612420 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.612590 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.612744 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.612906 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.613066 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.613245 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.613399 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.613558 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.613749 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.613924 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.614294 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.614466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.614620 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.614773 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.614927 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.615099 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.615345 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.616105 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.616284 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.616450 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.616604 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.616784 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.617040 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.617214 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.617376 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.617538 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.617692 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.617898 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.618142 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.618312 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.618593 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.618752 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.618912 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.619066 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.619066 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.619379 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:19:34.619542 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.619707 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.619869 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.620021 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.620190 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.620344 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.620505 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.620669 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.620830 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.621161 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.621911 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.622027 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.622147 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.622240 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.622333 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.622428 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.622555 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.622640 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.622733 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.622825 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.622911 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.623006 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.623091 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.623181 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.623277 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.623363 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.623445 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.623534 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.623677 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.623836 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.623987 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.624139 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.624139 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.624432 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.624563 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.624563 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.624861 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.625030 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.625206 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.625311 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.625386 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.625386 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.625611 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.625777 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.625777 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.625997 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.626091 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.626176 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.626273 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.626365 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.626463 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.626554 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.626554 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.626715 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.626804 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.626804 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.626804 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.627039 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.627129 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.627129 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.627271 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.627363 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.627448 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.627535 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.627619 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.627708 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.627792 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.627887 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.627887 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.628047 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.628137 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.628137 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.628279 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.628365 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.628449 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.628532 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.628620 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.628693 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.628776 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.628859 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.628948 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.628948 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.629120 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.629120 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.629279 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.629370 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.629370 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.629520 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.629611 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.629696 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.629810 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.629891 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.629963 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.630045 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.630139 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.630224 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.630305 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.630386 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.630468 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.630615 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.630730 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.630817 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.630898 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.630980 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.631079 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.631177 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.631268 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.631360 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.631444 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.631533 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.631623 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.631712 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.631786 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.631863 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.631934 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.632011 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.632108 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.632252 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.632390 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.632535 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.632687 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.632828 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.632968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.633120 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.633266 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.633417 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.633560 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.633698 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.633994 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.634127 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.634253 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.634253 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.634392 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.634463 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.634463 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.634463 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.634463 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.634463 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.634789 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.634869 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.634954 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.635027 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.635098 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.635174 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.635254 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.635334 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.635406 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.636904 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.636989 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.637061 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.637142 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.637229 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.637302 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.637381 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.637454 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.637524 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.637593 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.637670 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.637670 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.637830 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.637901 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.637901 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.638041 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.638124 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.638196 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.638274 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.638351 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.639134 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.639134 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.639134 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.639134 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.639403 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.639473 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.639543 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.639620 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.639863 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.639973 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.640203 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.640486 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.640709 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.641015 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.641179 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.641319 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.641623 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.641740 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.642011 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.642122 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.642322 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.642422 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.642648 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.642737 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.642975 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.643068 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.643294 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.643392 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.643617 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.643714 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.643931 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.644024 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.644445 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.644586 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.644759 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.645072 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.645176 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.645384 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.645697 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.645949 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.646119 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.646268 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.646414 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.646565 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.646733 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.647099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.647255 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.647393 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.647541 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.647677 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.647853 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.648004 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.648142 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.648281 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.648409 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.648554 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.648682 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.648804 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.648944 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.649079 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.649197 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.649328 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.649484 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.649619 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.649819 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.649979 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.650140 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.650278 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.650450 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.650597 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.650764 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.650901 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.651074 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.651220 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.651389 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.651522 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.651702 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.651838 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.652009 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.652153 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.652829 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.652964 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.653142 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.653451 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.653594 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.653918 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.654071 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.654238 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.654384 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.654551 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.654684 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.654862 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.654999 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.655171 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.655317 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.655505 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.655647 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.655801 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.655925 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.656163 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.656287 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.656478 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.656625 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.656766 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.656912 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.657102 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.657377 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.657515 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.657643 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.657883 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.658001 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.658158 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.658292 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.658420 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.658550 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.658679 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.658827 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.659073 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.659249 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.659378 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.659516 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.659649 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.659790 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.659932 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.660078 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.660288 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.660418 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.660683 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.660905 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.661008 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.661282 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.661505 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.661649 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.661921 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.662146 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.662284 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.662540 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.662977 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.663129 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.663418 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.663612 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.663761 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.664033 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.664240 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.664377 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.664632 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.664804 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.664936 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.665223 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.665372 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.665561 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.665854 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.666058 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.666252 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.666396 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.666534 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.666674 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.666817 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.666948 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.667076 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.667214 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.667425 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.667674 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.667837 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.668528 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.668691 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.668782 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.669154 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.669301 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.669578 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.669686 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.669924 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.670025 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.670239 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.670348 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.670554 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.670648 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.670867 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.670962 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.671180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.671284 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.671506 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.671610 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.671820 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.671914 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.672132 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.672234 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.672443 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.672553 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.672750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.672861 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.673061 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.673220 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.673378 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.673544 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.673890 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.673999 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.674206 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.674302 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.674525 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.674625 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.674843 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.674935 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.675165 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.675267 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.675487 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.675578 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.675801 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.675902 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.676159 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.676304 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.676573 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.676727 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.676815 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.676909 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.677118 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.677255 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.677406 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.677525 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.677726 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.677833 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.678054 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.678278 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.678408 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.678512 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.678647 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.678810 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.678957 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.679051 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.679264 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.679413 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.679563 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.679694 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.679867 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.680000 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.680168 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.680294 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.680446 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.680607 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.680759 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.680924 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.681066 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.681234 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.681359 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.681652 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.681804 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.682004 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.682108 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.682316 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.682409 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.682620 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.682713 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.682924 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.683026 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.683226 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.683320 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.683610 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.683708 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.684135 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.684237 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.684506 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.684677 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.684836 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.685016 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.685166 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.685362 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.685481 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.685672 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.685824 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.686007 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.686137 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.686335 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.686462 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.686645 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.686788 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.686952 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.687107 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.687257 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.687436 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.687569 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.687856 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.687981 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.688155 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.688255 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.688465 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.688558 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.688776 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.688881 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.689095 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.689195 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.689403 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.689497 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.689703 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.689872 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.690050 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.690167 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.690356 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.690476 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.690670 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.690771 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.690979 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.691081 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.691283 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.691377 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.691585 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.691686 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.691895 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.691995 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.692202 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.692302 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.692506 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.692600 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.692813 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.692913 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.693114 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.693207 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.693431 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.693532 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.693754 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.693852 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.694060 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.694164 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.694366 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.694460 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.694675 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.694768 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.694981 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.695089 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.695284 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.695378 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.695606 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.695707 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.695915 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.696016 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.696218 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.696363 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.696521 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.696648 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.696830 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.696932 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.697133 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.697234 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.697437 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.697538 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.697766 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.697888 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.698095 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.698200 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.698410 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.698511 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.698713 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.698862 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.699027 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.699128 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.699421 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.699549 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.699744 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.700038 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.700139 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.700361 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.700454 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.700664 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.700768 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.700972 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.701062 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.701276 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.701375 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.701579 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.701671 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.701916 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.702010 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.702228 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.702320 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.702532 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.702625 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.702836 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.702935 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.703142 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.703236 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.703447 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.703539 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.703750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.703850 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.704072 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.704165 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.704386 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.704489 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.704693 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.704787 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.705000 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.705103 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.705303 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.705396 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.705647 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.705768 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.705979 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.706086 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.706313 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.706637 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.706769 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.706959 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.707241 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.707341 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.707584 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.707814 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.707908 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.708213 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.708413 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.708527 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.708844 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.709007 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.709161 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.709476 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.709603 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.709815 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.710132 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.710261 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.710447 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.710764 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.710858 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.711083 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.711374 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.711474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.711968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.712076 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.712300 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.712566 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.712662 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.712919 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.713180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.713275 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.713539 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.713630 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.713878 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.713975 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.714195 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.714291 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.714509 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.714612 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.715337 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.715490 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.715640 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.715955 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.716053 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.716281 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.716400 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.716612 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.716718 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.716949 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.717053 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.717271 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.717373 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.717588 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.717685 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.717937 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.718032 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.718263 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.718394 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.718590 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.718710 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.718904 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.719007 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.719219 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.719323 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.719534 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.719629 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.719852 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.719950 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.720163 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.720269 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.720473 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.720567 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.720784 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.720877 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.721090 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.721191 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.721405 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.721498 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.721726 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.721821 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.722044 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.722165 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.722367 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.722508 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.722684 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.722777 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.723010 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.723105 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.723345 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.723439 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.723669 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.723769 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.723983 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.724086 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.724295 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.724393 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.724600 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.724693 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.725019 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.725121 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.725330 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.725431 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.725639 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.725769 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.725978 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.726105 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.726283 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.726432 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.726586 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.726751 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.726899 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.727073 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.727225 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.727402 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.727531 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.727711 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.727835 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.728018 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.728140 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.728334 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.728451 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.728648 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.728744 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.728955 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.729050 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.729278 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.729466 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.729591 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.729801 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.729952 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.730110 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.730229 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.731130 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.731231 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.731767 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.731873 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.732052 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.732145 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.732382 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.732485 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.732710 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.732811 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.733036 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.733138 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.733344 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.733447 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.733656 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.733776 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.733995 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.734101 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.734320 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.734414 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.734627 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.734718 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.734942 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.735047 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.735254 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.735345 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.735556 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.735648 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.735863 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.735968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.736179 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.736274 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.736491 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.736583 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.736797 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.736880 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.737111 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.737211 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.737418 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.737519 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.737764 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.737863 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.738078 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.738183 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.738387 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.738549 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.738696 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.738799 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.739009 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.739106 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.739315 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.739407 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.739625 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.739726 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.739926 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.740096 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.740232 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.740333 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.740543 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.740642 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.740847 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.740939 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.741154 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.741296 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.741460 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.741559 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.741782 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.741876 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.742087 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.742197 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.742396 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.742487 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.742697 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.742789 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.743018 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.743122 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.743331 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.743432 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.743652 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.743746 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.743966 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.744067 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.744266 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.744359 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.744586 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.744679 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.744896 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.744999 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.745199 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.745300 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.745501 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.745601 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.745826 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.745925 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.746224 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.746419 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.746757 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.746896 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.747081 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.747227 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.747415 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.747517 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.747752 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.747856 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.748053 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.748146 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.748361 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.748464 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.748670 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.748766 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.748995 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.749085 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.749307 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.749400 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.749618 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.749780 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.749948 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.750040 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.750254 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.750351 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.750561 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.750673 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.750861 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.750954 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.751166 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.751259 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.751471 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.751568 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.751778 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.751979 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.752094 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.752186 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.752366 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.752460 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.752666 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.752767 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.752984 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.753079 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.753287 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.753382 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.753608 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.753699 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.753940 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.754049 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.754243 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.754345 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.754547 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.754641 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.754848 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.754951 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.755184 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.755325 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.755488 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.755621 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.755819 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.755964 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.756129 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.756229 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.756445 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.756540 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.756768 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.756869 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.757075 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.757172 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.757377 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.757511 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.757695 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.757811 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.758031 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.758124 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.758344 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.758436 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.758656 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.758754 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.758969 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.759070 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.759286 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.759386 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.759599 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.759694 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.759909 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.760008 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.760227 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.760319 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.760540 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.760643 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.760859 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.760951 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.761216 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.761403 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.761543 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.761778 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.761915 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.762215 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.762345 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.762523 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.762746 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.762850 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.763065 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.763160 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.763382 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.763484 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.763698 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.763793 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.764012 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.764115 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.764316 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.764415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.764626 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.764726 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.764929 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.765028 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.765236 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.765330 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.765542 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.765636 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.765872 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.765978 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.766183 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.766277 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.766488 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.766580 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.766794 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.766900 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.767100 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.767236 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.767405 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.767506 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.767709 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.767815 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.768014 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.768115 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.768324 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.768417 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.768628 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.768730 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.768934 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.769034 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.769237 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.769329 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.769540 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.769634 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.769868 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.769964 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.770201 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.770296 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.770512 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.770609 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.770822 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.770924 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.771133 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.771236 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.771447 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.771541 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.771759 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.771855 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.772076 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.772178 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.772399 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.772492 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.772716 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.772823 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.773029 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.773131 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.773341 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.773433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.773652 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.773797 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.774002 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.774197 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.774316 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.774512 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.774614 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.774842 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.774942 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.775167 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.775269 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.775490 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.775583 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.775805 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.775906 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.776121 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.776269 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.776445 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.776548 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.776750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.776852 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.777054 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.777148 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.777914 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.778063 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.778230 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.778470 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.778604 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.778787 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.778887 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.779114 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.779254 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.779428 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.779532 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.779739 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.779831 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.780062 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.780169 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.780372 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.780462 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.780687 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.780903 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.781003 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.781252 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.781353 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.781570 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.781672 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.781924 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.782019 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.782249 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.782351 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.782566 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.782659 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.782873 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.782974 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.783196 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.783298 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.783502 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.783601 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.783805 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.783911 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.784118 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.784218 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.784425 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.784519 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.784729 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.784836 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.785009 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 16:19:34.785101 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.785331 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.785638 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.785968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.786275 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.786577 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.786901 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.787207 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.787511 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.788081 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.788390 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.788692 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.788996 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.789300 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.789607 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.789942 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.790246 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.790551 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.790853 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.791162 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.791464 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.791770 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.792118 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.792440 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.792743 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.793783 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.794340 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.794666 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.794996 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.795314 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.795627 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.795976 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.796294 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.796828 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.797163 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.797483 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.797852 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.798185 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.798494 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.798800 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.799107 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.799595 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.800175 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.800757 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.801335 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.801954 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.802546 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.803126 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.803725 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.804321 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.804912 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.805499 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.806672 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.806672 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.806951 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.807281 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.807635 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.807965 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.808290 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.808640 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.809240 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.809577 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.809922 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.810243 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.810559 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.810885 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.811217 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.811536 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.811846 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.812276 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.812591 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.812910 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.813233 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.813544 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.813890 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.814216 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.814530 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.814854 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.815167 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.815495 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.815829 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.816160 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.816482 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.816789 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.817095 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.817401 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.817734 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.818053 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.818365 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.818670 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.818973 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.819284 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.819593 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.819897 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.820199 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.820505 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.820812 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.821114 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.821416 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.821736 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.822042 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.822344 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.822649 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.822955 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.823256 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.823560 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.823859 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.824186 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.824646 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.825167 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.825513 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.825862 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.826196 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.826511 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.826837 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.827152 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.827478 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.827803 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.828120 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.828433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.828768 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.829080 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.829392 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.829730 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.830046 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.830358 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.830670 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.831195 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.831310 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.831613 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.831938 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.832256 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.832575 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.832894 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.833201 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.833529 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.833863 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.834175 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.834490 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.834801 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.835112 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.835426 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.835740 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.836064 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.836388 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.836698 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.837022 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.837348 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.837689 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.838023 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.838366 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.838720 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.839018 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.839323 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.839633 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:19:34.840420 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 16:19:34.845082 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO dbcounter [None req-d6635d2c-6cee-4447-b252-7420f1532221 None None] Registered counter for database nova_api May 25 16:19:34.865350 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_db.sqlalchemy.engines [None req-d6635d2c-6cee-4447-b252-7420f1532221 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117510) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:19:34.873498 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writer thread running {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:19:34.907699 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO dbcounter [None req-6fea2aea-f34f-4b61-80ec-96c051e84ab1 None None] Registered counter for database nova_api May 25 16:19:34.930820 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_db.sqlalchemy.engines [None req-6fea2aea-f34f-4b61-80ec-96c051e84ab1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117509) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:19:34.932387 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.context [None req-d6635d2c-6cee-4447-b252-7420f1532221 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0666b19a-5b2e-43ea-b2cf-5adf4d938b08(cell1) {{(pid=117510) load_cells /opt/stack/nova/nova/context.py:464}} May 25 16:19:34.937486 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d6635d2c-6cee-4447-b252-7420f1532221 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:34.939186 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d6635d2c-6cee-4447-b252-7420f1532221 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:34.939426 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writer thread running {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:19:34.940005 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d6635d2c-6cee-4447-b252-7420f1532221 None None] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:34.942086 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d6635d2c-6cee-4447-b252-7420f1532221 None None] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:34.944081 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO dbcounter [None req-d6635d2c-6cee-4447-b252-7420f1532221 None None] Registered counter for database nova_cell0 May 25 16:19:34.948256 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO dbcounter [None req-d6635d2c-6cee-4447-b252-7420f1532221 None None] Registered counter for database nova_cell1 May 25 16:19:34.956332 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_db.sqlalchemy.engines [None req-d6635d2c-6cee-4447-b252-7420f1532221 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117510) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:19:34.958673 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_db.sqlalchemy.engines [None req-d6635d2c-6cee-4447-b252-7420f1532221 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117510) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:19:34.964140 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writer thread running {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:19:34.966243 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writer thread running {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:19:34.998628 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.context [None req-6fea2aea-f34f-4b61-80ec-96c051e84ab1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0666b19a-5b2e-43ea-b2cf-5adf4d938b08(cell1) {{(pid=117509) load_cells /opt/stack/nova/nova/context.py:464}} May 25 16:19:35.002846 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6fea2aea-f34f-4b61-80ec-96c051e84ab1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:35.004453 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6fea2aea-f34f-4b61-80ec-96c051e84ab1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:35.005260 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6fea2aea-f34f-4b61-80ec-96c051e84ab1 None None] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:35.007373 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6fea2aea-f34f-4b61-80ec-96c051e84ab1 None None] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:35.009483 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO dbcounter [None req-6fea2aea-f34f-4b61-80ec-96c051e84ab1 None None] Registered counter for database nova_cell0 May 25 16:19:35.014165 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO dbcounter [None req-6fea2aea-f34f-4b61-80ec-96c051e84ab1 None None] Registered counter for database nova_cell1 May 25 16:19:35.022308 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_db.sqlalchemy.engines [None req-6fea2aea-f34f-4b61-80ec-96c051e84ab1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117509) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:19:35.024053 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_db.sqlalchemy.engines [None req-6fea2aea-f34f-4b61-80ec-96c051e84ab1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117509) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:19:35.031139 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writer thread running {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:19:35.031484 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writer thread running {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:19:35.130038 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO dbcounter [None req-d6635d2c-6cee-4447-b252-7420f1532221 None None] Registered counter for database nova_cell0 May 25 16:19:35.136728 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_db.sqlalchemy.engines [None req-d6635d2c-6cee-4447-b252-7420f1532221 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117510) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:19:35.141657 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writer thread running {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:19:35.181950 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO dbcounter [None req-6fea2aea-f34f-4b61-80ec-96c051e84ab1 None None] Registered counter for database nova_cell0 May 25 16:19:35.190834 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_db.sqlalchemy.engines [None req-6fea2aea-f34f-4b61-80ec-96c051e84ab1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117509) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:19:35.195149 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writer thread running {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:19:35.466835 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: WARNING keystonemiddleware.auth_token [None req-d6635d2c-6cee-4447-b252-7420f1532221 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 16:19:35.474116 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: WARNING keystonemiddleware.auth_token [None req-d6635d2c-6cee-4447-b252-7420f1532221 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 16:19:35.522336 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: WARNING keystonemiddleware.auth_token [None req-6fea2aea-f34f-4b61-80ec-96c051e84ab1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 16:19:35.530639 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: WARNING keystonemiddleware.auth_token [None req-6fea2aea-f34f-4b61-80ec-96c051e84ab1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 16:19:35.826712 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: WARNING keystonemiddleware.auth_token [None req-d6635d2c-6cee-4447-b252-7420f1532221 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 16:19:35.833135 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: WARNING keystonemiddleware.auth_token [None req-d6635d2c-6cee-4447-b252-7420f1532221 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 16:19:35.838698 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55aeeecc49c0 pid: 117510 (default app) May 25 16:19:35.880004 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: WARNING keystonemiddleware.auth_token [None req-6fea2aea-f34f-4b61-80ec-96c051e84ab1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 16:19:35.886072 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: WARNING keystonemiddleware.auth_token [None req-6fea2aea-f34f-4b61-80ec-96c051e84ab1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 16:19:35.892169 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55aeeecc49c0 pid: 117509 (default app) May 25 16:20:18.166033 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_api:SELECT=3 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:20:18.167586 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=3 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:20:18.168882 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell0:SELECT=3 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:20:18.173668 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell0:SELECT=3 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:20:19.737325 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-017e2b95-d897-4e01-8f11-2f5cb115c43a tempest-VolumesGetTestJSON-1762074038 tempest-VolumesGetTestJSON-1762074038-project] Action: 'create', calling method: .version_select at 0x7f51f00dfc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1675698706", "metadata": {"Type": "work"}}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:20:21.975558 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_api:SELECT=3 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:20:21.976713 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell0:SELECT=3 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:20:21.977458 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=3 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:20:21.980909 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell0:SELECT=3 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:20:22.658224 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-017e2b95-d897-4e01-8f11-2f5cb115c43a tempest-VolumesGetTestJSON-1762074038 tempest-VolumesGetTestJSON-1762074038-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.497370 May 25 16:20:22.658855 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1155 bytes} [Wed May 25 16:20:18 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4500 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 25 16:20:22.672948 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-cf9df821-21dc-4a50-bd38-f01226e09371 tempest-VolumesGetTestJSON-1762074038 tempest-VolumesGetTestJSON-1762074038-project] Calling method '.version_select at 0x7f51eff31b80>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:22.818835 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-cf9df821-21dc-4a50-bd38-f01226e09371 tempest-VolumesGetTestJSON-1762074038 tempest-VolumesGetTestJSON-1762074038-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/74c96e88-bf2b-4c5b-97f3-6468cf1a9b4f" status: 200 len: 353 microversion: 2.1 time: 0.150726 May 25 16:20:22.819823 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 2/2] 10.222.0.42 () {58 vars in 1244 bytes} [Wed May 25 16:20:22 2022] GET /compute/v2.1/os-volumes/74c96e88-bf2b-4c5b-97f3-6468cf1a9b4f => generated 353 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:20:22.862163 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-e2d3e44a-6044-4b47-ae9d-f28f852cde1d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-595222541", "imageRef": "e74cccc1-cd1b-4dfc-8e47-3e4a832649a8", "flavorRef": "452", "networks": [{"uuid": "05183988-e2ff-45ca-a056-5d9e8d3fed8e"}]}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:20:23.490659 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.network.neutron [None req-e2d3e44a-6044-4b47-ae9d-f28f852cde1d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] validate_networks() for [('05183988-e2ff-45ca-a056-5d9e8d3fed8e', None, None, None, None, None)] {{(pid=117509) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:20:23.835909 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-edf369ba-c2a0-4139-b2a0-e509f4776790 tempest-VolumesGetTestJSON-1762074038 tempest-VolumesGetTestJSON-1762074038-project] Calling method '.version_select at 0x7f51eff31dc0>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:23.939092 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-edf369ba-c2a0-4139-b2a0-e509f4776790 tempest-VolumesGetTestJSON-1762074038 tempest-VolumesGetTestJSON-1762074038-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/74c96e88-bf2b-4c5b-97f3-6468cf1a9b4f" status: 200 len: 354 microversion: 2.1 time: 0.110990 May 25 16:20:23.940145 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 3/3] 10.222.0.42 () {58 vars in 1244 bytes} [Wed May 25 16:20:23 2022] GET /compute/v2.1/os-volumes/74c96e88-bf2b-4c5b-97f3-6468cf1a9b4f => generated 354 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:20:23.954388 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-2d12ca86-88cb-496a-8845-9123fd58c388 tempest-VolumesGetTestJSON-1762074038 tempest-VolumesGetTestJSON-1762074038-project] Calling method '.version_select at 0x7f51eff47310>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:24.008268 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-2d12ca86-88cb-496a-8845-9123fd58c388 tempest-VolumesGetTestJSON-1762074038 tempest-VolumesGetTestJSON-1762074038-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/74c96e88-bf2b-4c5b-97f3-6468cf1a9b4f" status: 200 len: 354 microversion: 2.1 time: 0.058253 May 25 16:20:24.008868 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 4/4] 10.222.0.42 () {58 vars in 1244 bytes} [Wed May 25 16:20:23 2022] GET /compute/v2.1/os-volumes/74c96e88-bf2b-4c5b-97f3-6468cf1a9b4f => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:20:24.026263 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-da20d0be-7a97-441a-a426-92076b4697e2 tempest-VolumesGetTestJSON-1762074038 tempest-VolumesGetTestJSON-1762074038-project] Calling method '.version_select at 0x7f51eff479d0>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:24.120852 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-da20d0be-7a97-441a-a426-92076b4697e2 tempest-VolumesGetTestJSON-1762074038 tempest-VolumesGetTestJSON-1762074038-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/74c96e88-bf2b-4c5b-97f3-6468cf1a9b4f" status: 202 len: 0 microversion: 2.1 time: 0.098875 May 25 16:20:24.129698 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 5/5] 10.222.0.42 () {58 vars in 1247 bytes} [Wed May 25 16:20:24 2022] DELETE /compute/v2.1/os-volumes/74c96e88-bf2b-4c5b-97f3-6468cf1a9b4f => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 16:20:24.143610 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-a50f62a3-1b02-4374-9d87-c39e172b9737 tempest-VolumesGetTestJSON-1762074038 tempest-VolumesGetTestJSON-1762074038-project] Calling method '.version_select at 0x7f51eff47af0>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:24.209202 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-a50f62a3-1b02-4374-9d87-c39e172b9737 tempest-VolumesGetTestJSON-1762074038 tempest-VolumesGetTestJSON-1762074038-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/74c96e88-bf2b-4c5b-97f3-6468cf1a9b4f" status: 200 len: 353 microversion: 2.1 time: 0.073975 May 25 16:20:24.210353 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 6/6] 10.222.0.42 () {58 vars in 1244 bytes} [Wed May 25 16:20:24 2022] GET /compute/v2.1/os-volumes/74c96e88-bf2b-4c5b-97f3-6468cf1a9b4f => generated 353 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:20:25.222986 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-dcf73e29-f952-422e-9942-e14b3e91ff54 tempest-VolumesGetTestJSON-1762074038 tempest-VolumesGetTestJSON-1762074038-project] Calling method '.version_select at 0x7f51eff47550>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:25.278702 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.wsgi [None req-dcf73e29-f952-422e-9942-e14b3e91ff54 tempest-VolumesGetTestJSON-1762074038 tempest-VolumesGetTestJSON-1762074038-project] HTTP exception thrown: Volume 74c96e88-bf2b-4c5b-97f3-6468cf1a9b4f could not be found. May 25 16:20:25.287973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-dcf73e29-f952-422e-9942-e14b3e91ff54 tempest-VolumesGetTestJSON-1762074038 tempest-VolumesGetTestJSON-1762074038-project] Request method failure captured: May 25 16:20:25.287973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: request: GET /compute/v2.1/os-volumes/74c96e88-bf2b-4c5b-97f3-6468cf1a9b4f HTTP/1.1 May 25 16:20:25.287973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept: application/json May 25 16:20:25.287973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept-Encoding: identity May 25 16:20:25.287973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Connection: close May 25 16:20:25.287973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Length: 0 May 25 16:20:25.287973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Type: application/json May 25 16:20:25.287973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Host: 10.222.0.42 May 25 16:20:25.287973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Openstack-System-Scope: None May 25 16:20:25.287973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: User-Agent: python-urllib3/1.26.9 May 25 16:20:25.287973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Auth-Token: gAAAAABijldClPnKV012kFyQj-SdrAty6HobYw8_LX3tFy_cZMSPPBgMXAyfeizUB_1DucT_kzQceyhl8otehQhJncXXmAqs8iTJmlutoe4zOxEoM6XMUT-LB2BIQSh4F1j-ZqYWpM3e-SRQ34LWT00Y42Wc9C2_WNU-spinqXODVJ28mFcfuKA May 25 16:20:25.287973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Id: None May 25 16:20:25.287973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Name: None May 25 16:20:25.287973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Identity-Status: Confirmed May 25 16:20:25.287973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Is-Admin-Project: True May 25 16:20:25.287973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Id: default May 25 16:20:25.287973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Name: Default May 25 16:20:25.287973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Id: 7ae7d1ac52ec41c7a14e107347da454f May 25 16:20:25.287973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Name: tempest-VolumesGetTestJSON-1762074038 May 25 16:20:25.287973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Role: reader,member May 25 16:20:25.287973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Roles: reader,member May 25 16:20:25.289279 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7ae7d1ac52ec41c7a14e107347da454f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7ae7d1ac52ec41c7a14e107347da454f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7ae7d1ac52ec41c7a14e107347da454f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7ae7d1ac52ec41c7a14e107347da454f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:20:25.289279 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant: tempest-VolumesGetTestJSON-1762074038 May 25 16:20:25.289279 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Id: 7ae7d1ac52ec41c7a14e107347da454f May 25 16:20:25.289279 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Name: tempest-VolumesGetTestJSON-1762074038 May 25 16:20:25.289279 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User: tempest-VolumesGetTestJSON-1762074038-project May 25 16:20:25.289279 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Id: default May 25 16:20:25.289279 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Name: Default May 25 16:20:25.289279 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Id: c773fb31a56f48d196e073f9e5e350a1 May 25 16:20:25.289279 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Name: tempest-VolumesGetTestJSON-1762074038-project May 25 16:20:25.289279 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: method: May 25 16:20:25.289279 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: exception: Volume 74c96e88-bf2b-4c5b-97f3-6468cf1a9b4f could not be found. May 25 16:20:25.289279 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: action_args: {'id': '74c96e88-bf2b-4c5b-97f3-6468cf1a9b4f'} May 25 16:20:25.289279 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:20:25.290435 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:20:25.290435 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 16:20:25.290435 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 16:20:25.290435 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 16:20:25.290435 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 16:20:25.290435 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 16:20:25.290435 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 16:20:25.290435 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 16:20:25.290435 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 16:20:25.290435 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 16:20:25.290435 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 16:20:25.290435 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:20:25.290435 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:20:25.290435 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:20:25.290435 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:20:25.290435 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 74c96e88-bf2b-4c5b-97f3-6468cf1a9b4f could not be found. (HTTP 404) (Request-ID: req-e314bf3c-1f44-4c41-8ad3-9af17831655f) May 25 16:20:25.290435 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:20:25.290435 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:20:25.290435 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:20:25.292008 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:20:25.292008 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 25 16:20:25.292008 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 25 16:20:25.292008 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 16:20:25.292008 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 16:20:25.292008 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 16:20:25.292008 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 16:20:25.292008 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 16:20:25.292008 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 16:20:25.292008 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 16:20:25.292008 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 16:20:25.292008 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 16:20:25.292008 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 16:20:25.292008 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 16:20:25.292008 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 16:20:25.292008 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 16:20:25.292008 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 16:20:25.292008 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 16:20:25.292008 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 16:20:25.294978 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:20:25.294978 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:20:25.294978 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:20:25.294978 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:20:25.294978 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 74c96e88-bf2b-4c5b-97f3-6468cf1a9b4f could not be found. May 25 16:20:25.294978 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:20:25.294978 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:20:25.294978 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:20:25.294978 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:20:25.294978 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:20:25.294978 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:20:25.294978 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:20:25.294978 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:20:25.294978 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 16:20:25.294978 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 16:20:25.294978 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:20:25.294978 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:20:25.294978 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 25 16:20:25.294978 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:20:25.297085 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 74c96e88-bf2b-4c5b-97f3-6468cf1a9b4f could not be found. May 25 16:20:25.297085 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:20:25.297085 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:20:25.297085 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:20:25.297085 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:20:25.297085 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:20:25.297085 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:20:25.297085 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:20:25.297085 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:20:25.297085 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 74c96e88-bf2b-4c5b-97f3-6468cf1a9b4f could not be found. May 25 16:20:25.297085 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:20:25.297085 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-dcf73e29-f952-422e-9942-e14b3e91ff54 tempest-VolumesGetTestJSON-1762074038 tempest-VolumesGetTestJSON-1762074038-project] Returning 404 to user: Volume 74c96e88-bf2b-4c5b-97f3-6468cf1a9b4f could not be found. {{(pid=117510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:20:25.297085 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-dcf73e29-f952-422e-9942-e14b3e91ff54 tempest-VolumesGetTestJSON-1762074038 tempest-VolumesGetTestJSON-1762074038-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/74c96e88-bf2b-4c5b-97f3-6468cf1a9b4f" status: 404 len: 109 microversion: 2.1 time: 0.073918 May 25 16:20:25.297085 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 7/7] 10.222.0.42 () {58 vars in 1244 bytes} [Wed May 25 16:20:25 2022] GET /compute/v2.1/os-volumes/74c96e88-bf2b-4c5b-97f3-6468cf1a9b4f => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:20:26.334819 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-e2d3e44a-6044-4b47-ae9d-f28f852cde1d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Flavor limits 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:20:26.335303 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-e2d3e44a-6044-4b47-ae9d-f28f852cde1d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Image limits 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:20:26.335707 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-e2d3e44a-6044-4b47-ae9d-f28f852cde1d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Flavor pref 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:20:26.336116 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-e2d3e44a-6044-4b47-ae9d-f28f852cde1d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Image pref 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:20:26.336535 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-e2d3e44a-6044-4b47-ae9d-f28f852cde1d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:20:26.388148 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e2d3e44a-6044-4b47-ae9d-f28f852cde1d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:26.396992 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e2d3e44a-6044-4b47-ae9d-f28f852cde1d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:26.401592 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e2d3e44a-6044-4b47-ae9d-f28f852cde1d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:26.404432 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e2d3e44a-6044-4b47-ae9d-f28f852cde1d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:26.472668 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-e2d3e44a-6044-4b47-ae9d-f28f852cde1d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Getting quotas for project 9b5ee0d2e59647dc98721de1b8dfb4db. Resources: {'ram', 'cores', 'instances'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:20:26.490542 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-e2d3e44a-6044-4b47-ae9d-f28f852cde1d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Getting quotas for user 18cd966ad655466e85930f7c505fb360 and project 9b5ee0d2e59647dc98721de1b8dfb4db. Resources: {'ram', 'cores', 'instances'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:20:26.523197 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-e2d3e44a-6044-4b47-ae9d-f28f852cde1d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Going to run 1 instances... {{(pid=117509) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:20:26.528481 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-e2d3e44a-6044-4b47-ae9d-f28f852cde1d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e74cccc1-cd1b-4dfc-8e47-3e4a832649a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:20:26.692248 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-e2d3e44a-6044-4b47-ae9d-f28f852cde1d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.733695 May 25 16:20:26.693451 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 1/8] 10.222.0.42 () {60 vars in 1146 bytes} [Wed May 25 16:20:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 4736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:20:26.712113 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-9c9a8248-ee82-4972-87c4-73387e1e79fc tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:26.713742 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-9c9a8248-ee82-4972-87c4-73387e1e79fc tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:27.034554 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-9c9a8248-ee82-4972-87c4-73387e1e79fc tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18cd966ad655466e85930f7c505fb360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5ee0d2e59647dc98721de1b8dfb4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:27.075033 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-9c9a8248-ee82-4972-87c4-73387e1e79fc tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 200 len: 1214 microversion: 2.1 time: 0.375022 May 25 16:20:27.075546 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 8/9] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:26 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 1214 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:28.095315 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-06d8a8a3-fd2d-42f4-9acb-457926f64800 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:28.096339 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-06d8a8a3-fd2d-42f4-9acb-457926f64800 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:28.264143 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-06d8a8a3-fd2d-42f4-9acb-457926f64800 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18cd966ad655466e85930f7c505fb360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5ee0d2e59647dc98721de1b8dfb4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:28.299893 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-06d8a8a3-fd2d-42f4-9acb-457926f64800 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 200 len: 1214 microversion: 2.1 time: 0.210800 May 25 16:20:28.302193 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 2/10] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:28 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 1214 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:29.319179 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-0295ea23-8aec-414a-8592-ff25b71ba27b tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:29.319835 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-0295ea23-8aec-414a-8592-ff25b71ba27b tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:29.333866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0295ea23-8aec-414a-8592-ff25b71ba27b tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:29.334319 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0295ea23-8aec-414a-8592-ff25b71ba27b tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:29.335091 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0295ea23-8aec-414a-8592-ff25b71ba27b tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:29.342725 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0295ea23-8aec-414a-8592-ff25b71ba27b tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:29.475629 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-88cd1e75-cc03-4166-a033-6ae6b13e50c9 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Action: 'create', calling method: .version_select at 0x7f51f08c10d0>, body: {"keypair": {"name": "tempest-keypair-1112922698", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJxEl0For3b4acrX8ltcN9mPxnnT9ofeyU+hgzTg0g5TYgeBY9sdJoGkFQmKf+5+7e7M/nBKvsVQN4iUnvMTPCOtbzpR9KtJlnoXtKrJ6STaLUHqrPHVWruaSoQZonU7Q=="}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:20:29.626452 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-88cd1e75-cc03-4166-a033-6ae6b13e50c9 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Getting quotas for project 9d234edace28441282f594f0e03cacc5. Resources: {'key_pairs'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:20:29.643985 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-88cd1e75-cc03-4166-a033-6ae6b13e50c9 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Getting quotas for user b781c4c6cb61439fb781988a7da028ff and project 9d234edace28441282f594f0e03cacc5. Resources: {'key_pairs'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:20:29.754724 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-88cd1e75-cc03-4166-a033-6ae6b13e50c9 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.021001 May 25 16:20:29.756091 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 9/11] 10.222.0.42 () {60 vars in 1158 bytes} [Wed May 25 16:20:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:20:29.803308 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-0295ea23-8aec-414a-8592-ff25b71ba27b tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18cd966ad655466e85930f7c505fb360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5ee0d2e59647dc98721de1b8dfb4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:29.830537 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-0295ea23-8aec-414a-8592-ff25b71ba27b tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 200 len: 1210 microversion: 2.1 time: 0.515395 May 25 16:20:29.838746 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 3/12] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:29 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 1210 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:20:30.854653 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-fdd456f1-3748-42b8-b8da-72c827f24665 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:30.855898 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-fdd456f1-3748-42b8-b8da-72c827f24665 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:30.872830 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-fdd456f1-3748-42b8-b8da-72c827f24665 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:30.873819 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-fdd456f1-3748-42b8-b8da-72c827f24665 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:30.875171 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-fdd456f1-3748-42b8-b8da-72c827f24665 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:30.878548 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-fdd456f1-3748-42b8-b8da-72c827f24665 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:31.249486 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-fdd456f1-3748-42b8-b8da-72c827f24665 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18cd966ad655466e85930f7c505fb360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5ee0d2e59647dc98721de1b8dfb4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:31.276483 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-fdd456f1-3748-42b8-b8da-72c827f24665 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 200 len: 1272 microversion: 2.1 time: 0.424070 May 25 16:20:31.278102 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 10/13] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:30 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 1272 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:32.296273 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-ce7fe284-0fc4-4ed7-bac2-047efb3ddf7d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:32.297604 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-ce7fe284-0fc4-4ed7-bac2-047efb3ddf7d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:32.304901 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ce7fe284-0fc4-4ed7-bac2-047efb3ddf7d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:32.318477 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ce7fe284-0fc4-4ed7-bac2-047efb3ddf7d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:32.319551 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ce7fe284-0fc4-4ed7-bac2-047efb3ddf7d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:32.320140 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ce7fe284-0fc4-4ed7-bac2-047efb3ddf7d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:32.519079 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-ce7fe284-0fc4-4ed7-bac2-047efb3ddf7d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18cd966ad655466e85930f7c505fb360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5ee0d2e59647dc98721de1b8dfb4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:32.531933 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-ce7fe284-0fc4-4ed7-bac2-047efb3ddf7d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 200 len: 1272 microversion: 2.1 time: 0.239941 May 25 16:20:32.532996 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 4/14] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:32 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 1272 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:33.559356 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-f0894612-73e8-42ff-851c-9e4c39ee5552 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:33.560542 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-f0894612-73e8-42ff-851c-9e4c39ee5552 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:33.574535 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f0894612-73e8-42ff-851c-9e4c39ee5552 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:33.575503 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f0894612-73e8-42ff-851c-9e4c39ee5552 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:33.576435 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f0894612-73e8-42ff-851c-9e4c39ee5552 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:33.577026 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f0894612-73e8-42ff-851c-9e4c39ee5552 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:34.934513 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-f0894612-73e8-42ff-851c-9e4c39ee5552 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18cd966ad655466e85930f7c505fb360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5ee0d2e59647dc98721de1b8dfb4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:34.966705 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-f0894612-73e8-42ff-851c-9e4c39ee5552 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 200 len: 1314 microversion: 2.1 time: 1.419271 May 25 16:20:34.972076 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 11/15] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:33 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 1314 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:35.991523 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-431f255b-4604-4b36-a9f5-71e1200f20cb tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:35.992699 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-431f255b-4604-4b36-a9f5-71e1200f20cb tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:36.013042 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-431f255b-4604-4b36-a9f5-71e1200f20cb tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:36.014080 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-431f255b-4604-4b36-a9f5-71e1200f20cb tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:36.016603 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-431f255b-4604-4b36-a9f5-71e1200f20cb tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:36.019399 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-431f255b-4604-4b36-a9f5-71e1200f20cb tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:36.424081 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell0:SELECT=2 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:20:37.906742 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-431f255b-4604-4b36-a9f5-71e1200f20cb tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18cd966ad655466e85930f7c505fb360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5ee0d2e59647dc98721de1b8dfb4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:37.932908 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-431f255b-4604-4b36-a9f5-71e1200f20cb tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 200 len: 1314 microversion: 2.1 time: 1.936649 May 25 16:20:37.943094 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 5/16] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:35 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 1314 bytes in 1947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:38.954548 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-c586365b-d251-4f7a-8219-f7af0f427852 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:38.955295 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-c586365b-d251-4f7a-8219-f7af0f427852 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:38.971793 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c586365b-d251-4f7a-8219-f7af0f427852 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:38.972407 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c586365b-d251-4f7a-8219-f7af0f427852 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:38.973330 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c586365b-d251-4f7a-8219-f7af0f427852 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:38.977260 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c586365b-d251-4f7a-8219-f7af0f427852 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:39.354467 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-c586365b-d251-4f7a-8219-f7af0f427852 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18cd966ad655466e85930f7c505fb360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5ee0d2e59647dc98721de1b8dfb4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:39.366756 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-c586365b-d251-4f7a-8219-f7af0f427852 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 200 len: 1314 microversion: 2.1 time: 0.416464 May 25 16:20:39.369773 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 12/17] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:38 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:39.500091 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell0:SELECT=8 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:20:39.755302 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-9b65ae10-6b54-480f-a232-8757a06f8923 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Action: 'create', calling method: .version_select at 0x7f51eedd55e0>, body: {"keypair": {"name": "tempest-keypair-128269002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBltPCbHzOUQATIwYel8S4wAVerjIka9HKh8DCEGY9SENk2uXKx7az652TFFO44m9S3rcseH6KewrelSUIFkWO52UFs3kQESbnNzRFYunjIsj0B1N2nE0m4JVTtooiV0pA=="}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:20:39.837804 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-9b65ae10-6b54-480f-a232-8757a06f8923 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Getting quotas for project 3e8c39550e4e41e79cc56aa7d22ae052. Resources: {'key_pairs'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:20:39.843935 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-9b65ae10-6b54-480f-a232-8757a06f8923 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Getting quotas for user 15fae427f22d476fa0e378949de41292 and project 3e8c39550e4e41e79cc56aa7d22ae052. Resources: {'key_pairs'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:20:39.970274 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-9b65ae10-6b54-480f-a232-8757a06f8923 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.468889 May 25 16:20:39.971209 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 6/18] 10.222.0.42 () {60 vars in 1158 bytes} [Wed May 25 16:20:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:20:40.078306 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell0:SELECT=6 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:20:40.200569 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-e739e1f2-aaad-4637-9b12-bfd45996af21 req-30a3182b-143b-48b9-b7b2-945888aa1372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f33f1186-4082-43e1-878c-77a547575727", "tag": "896b3b44-139e-492c-954c-cf69765ec184"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:20:40.227293 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-e739e1f2-aaad-4637-9b12-bfd45996af21 req-30a3182b-143b-48b9-b7b2-945888aa1372 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:40.228436 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-e739e1f2-aaad-4637-9b12-bfd45996af21 req-30a3182b-143b-48b9-b7b2-945888aa1372 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:40.285389 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-e739e1f2-aaad-4637-9b12-bfd45996af21 req-30a3182b-143b-48b9-b7b2-945888aa1372 service nova] Creating event network-changed:896b3b44-139e-492c-954c-cf69765ec184 for instance f33f1186-4082-43e1-878c-77a547575727 on hv-cinder-84327 May 25 16:20:40.285926 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-e739e1f2-aaad-4637-9b12-bfd45996af21 req-30a3182b-143b-48b9-b7b2-945888aa1372 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117510) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 25 16:20:40.288118 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dde33e3d-fec8-4e07-82b5-0b54cc39b1ed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:40.288777 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dde33e3d-fec8-4e07-82b5-0b54cc39b1ed None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:40.289752 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dde33e3d-fec8-4e07-82b5-0b54cc39b1ed None None] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:40.290977 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dde33e3d-fec8-4e07-82b5-0b54cc39b1ed None None] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:40.306861 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.compute.rpcapi [None req-dde33e3d-fec8-4e07-82b5-0b54cc39b1ed None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 25 16:20:40.308421 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dde33e3d-fec8-4e07-82b5-0b54cc39b1ed None None] Releasing lock "compute-rpcapi-router" {{(pid=117510) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 25 16:20:40.392065 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-36ecfb67-c862-4f28-adf8-aac7fb80f049 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:40.396127 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-36ecfb67-c862-4f28-adf8-aac7fb80f049 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:40.422088 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-dde33e3d-fec8-4e07-82b5-0b54cc39b1ed None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.348931 May 25 16:20:40.423616 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-36ecfb67-c862-4f28-adf8-aac7fb80f049 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:40.441585 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 13/19] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:20:40.442555 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-36ecfb67-c862-4f28-adf8-aac7fb80f049 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:40.454422 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-36ecfb67-c862-4f28-adf8-aac7fb80f049 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:40.455189 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-36ecfb67-c862-4f28-adf8-aac7fb80f049 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:41.444340 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-47556e34-ac6b-4e42-b539-d47d3c14ff0e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-31520655", "imageRef": "e74cccc1-cd1b-4dfc-8e47-3e4a832649a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:20:41.471579 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-36ecfb67-c862-4f28-adf8-aac7fb80f049 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18cd966ad655466e85930f7c505fb360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5ee0d2e59647dc98721de1b8dfb4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:41.504532 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-36ecfb67-c862-4f28-adf8-aac7fb80f049 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 200 len: 1314 microversion: 2.1 time: 1.122130 May 25 16:20:41.508081 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 7/20] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:40 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 1314 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:41.703559 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.network.neutron [None req-47556e34-ac6b-4e42-b539-d47d3c14ff0e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] validate_networks() for [('07eab40d-bc82-4433-9d88-2c85f65e23df', None, None, None, None, None)] {{(pid=117510) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:20:42.313276 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-0917ca74-85da-4aeb-837d-cbc1b4f0e711 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1794382172", "imageRef": "e74cccc1-cd1b-4dfc-8e47-3e4a832649a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "924a9156-87e8-4a10-ac35-4ba66726a4f5"}], "security_groups": [{"name": "tempest-securitygroup--2129154082"}], "key_name": "tempest-keypair-1112922698", "user_data": "}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:20:43.132615 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.network.neutron [None req-0917ca74-85da-4aeb-837d-cbc1b4f0e711 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] validate_networks() for [('924a9156-87e8-4a10-ac35-4ba66726a4f5', None, None, None, None, None)] {{(pid=117509) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:20:46.536840 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-0917ca74-85da-4aeb-837d-cbc1b4f0e711 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Flavor limits 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:20:46.537493 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-0917ca74-85da-4aeb-837d-cbc1b4f0e711 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Image limits 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:20:46.538315 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-0917ca74-85da-4aeb-837d-cbc1b4f0e711 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Flavor pref 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:20:46.538852 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-0917ca74-85da-4aeb-837d-cbc1b4f0e711 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Image pref 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:20:46.539377 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-0917ca74-85da-4aeb-837d-cbc1b4f0e711 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:20:46.559800 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0917ca74-85da-4aeb-837d-cbc1b4f0e711 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:46.562487 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0917ca74-85da-4aeb-837d-cbc1b4f0e711 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:46.565287 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0917ca74-85da-4aeb-837d-cbc1b4f0e711 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:46.567629 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0917ca74-85da-4aeb-837d-cbc1b4f0e711 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:46.640824 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-0917ca74-85da-4aeb-837d-cbc1b4f0e711 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Getting quotas for project 9d234edace28441282f594f0e03cacc5. Resources: {'ram', 'cores', 'instances'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:20:46.676118 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-0917ca74-85da-4aeb-837d-cbc1b4f0e711 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Getting quotas for user b781c4c6cb61439fb781988a7da028ff and project 9d234edace28441282f594f0e03cacc5. Resources: {'ram', 'cores', 'instances'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:20:46.781255 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-0917ca74-85da-4aeb-837d-cbc1b4f0e711 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Going to run 1 instances... {{(pid=117509) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:20:46.798758 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-0917ca74-85da-4aeb-837d-cbc1b4f0e711 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e74cccc1-cd1b-4dfc-8e47-3e4a832649a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:20:46.943348 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-47556e34-ac6b-4e42-b539-d47d3c14ff0e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Flavor limits 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:20:46.944751 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-47556e34-ac6b-4e42-b539-d47d3c14ff0e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Image limits 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:20:46.945516 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-47556e34-ac6b-4e42-b539-d47d3c14ff0e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Flavor pref 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:20:46.946096 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-47556e34-ac6b-4e42-b539-d47d3c14ff0e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Image pref 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:20:46.947513 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-47556e34-ac6b-4e42-b539-d47d3c14ff0e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:20:46.979046 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-47556e34-ac6b-4e42-b539-d47d3c14ff0e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:46.980201 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-47556e34-ac6b-4e42-b539-d47d3c14ff0e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:46.981949 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-47556e34-ac6b-4e42-b539-d47d3c14ff0e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:46.987546 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-0917ca74-85da-4aeb-837d-cbc1b4f0e711 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.680010 May 25 16:20:46.988882 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 8/21] 10.222.0.42 () {60 vars in 1146 bytes} [Wed May 25 16:20:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 4683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:20:46.997067 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-6c8a9927-5b68-4857-ad6b-4bbd03c74ac8 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:46.998479 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-6c8a9927-5b68-4857-ad6b-4bbd03c74ac8 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:47.004750 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-47556e34-ac6b-4e42-b539-d47d3c14ff0e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:47.023448 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6c8a9927-5b68-4857-ad6b-4bbd03c74ac8 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:47.024355 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6c8a9927-5b68-4857-ad6b-4bbd03c74ac8 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:47.025975 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6c8a9927-5b68-4857-ad6b-4bbd03c74ac8 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:47.026839 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6c8a9927-5b68-4857-ad6b-4bbd03c74ac8 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:47.145856 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-47556e34-ac6b-4e42-b539-d47d3c14ff0e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Getting quotas for project 95d1e25b20a146c198dfeda0dc43cd72. Resources: {'ram', 'cores', 'instances'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:20:47.166921 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-47556e34-ac6b-4e42-b539-d47d3c14ff0e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Getting quotas for user 30de794b71b343289491531dfbe37f53 and project 95d1e25b20a146c198dfeda0dc43cd72. Resources: {'ram', 'cores', 'instances'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:20:47.208175 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-47556e34-ac6b-4e42-b539-d47d3c14ff0e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Going to run 1 instances... {{(pid=117510) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:20:47.217444 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-47556e34-ac6b-4e42-b539-d47d3c14ff0e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e74cccc1-cd1b-4dfc-8e47-3e4a832649a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:20:47.460901 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-47556e34-ac6b-4e42-b539-d47d3c14ff0e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.207645 May 25 16:20:47.470870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 14/22] 10.222.0.42 () {60 vars in 1146 bytes} [Wed May 25 16:20:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 6230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:20:47.610158 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-6c8a9927-5b68-4857-ad6b-4bbd03c74ac8 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18cd966ad655466e85930f7c505fb360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5ee0d2e59647dc98721de1b8dfb4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:47.636351 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-6c8a9927-5b68-4857-ad6b-4bbd03c74ac8 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 200 len: 1314 microversion: 2.1 time: 0.643798 May 25 16:20:47.637949 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 9/23] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:46 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 1314 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:47.659311 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-3b4319fa-6ea9-4cc5-a098-eb4b4cf956a7 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:47.661379 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-3b4319fa-6ea9-4cc5-a098-eb4b4cf956a7 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:47.923186 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-3b4319fa-6ea9-4cc5-a098-eb4b4cf956a7 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:47.931301 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-3b4319fa-6ea9-4cc5-a098-eb4b4cf956a7 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98" status: 200 len: 1242 microversion: 2.1 time: 0.291780 May 25 16:20:47.939488 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 10/24] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:47 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 => generated 1242 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:47.948450 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-79f37f1e-9fd0-4df8-88c7-cd224167d686 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:47.961034 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-79f37f1e-9fd0-4df8-88c7-cd224167d686 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:48.510818 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-79f37f1e-9fd0-4df8-88c7-cd224167d686 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:48.523475 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-79f37f1e-9fd0-4df8-88c7-cd224167d686 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1220 microversion: 2.1 time: 0.581733 May 25 16:20:48.527660 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 11/25] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:47 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1220 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:48.552350 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-ba18a338-a7e9-4aea-9f66-ff4d0b4ebf42 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1467795947", "imageRef": "e74cccc1-cd1b-4dfc-8e47-3e4a832649a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c47b68ec-cf9c-457c-8d2b-ef3d80fa25c9"}], "security_groups": [{"name": "tempest-securitygroup--1171836641"}], "key_name": "tempest-keypair-128269002", "user_data": "}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:20:48.552590 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-aec0e71c-4ae8-44eb-820b-40aa3318663d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Action: 'create', calling method: .version_select at 0x7f51ee470310>, body: {"keypair": {"name": "tempest-keypair-456065417", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrhZOFV+lH4omKLjbJosuCO46kxGt4NXXFSRZXSsvty+qrAuNHYTFFyl5/Nci52TZpSB2TNN0cJpLDa8AodjdiSt3mcrtZU5Eo4F2c3irWowyOjKpRMjntH9uLvvQWHLg=="}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:20:48.571751 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=4 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:20:48.606437 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-aec0e71c-4ae8-44eb-820b-40aa3318663d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Getting quotas for project e916473814d44ac1ae6339f0d052daa1. Resources: {'key_pairs'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:20:48.616977 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-aec0e71c-4ae8-44eb-820b-40aa3318663d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Getting quotas for user 9178e89a790d48d19b25c4c22bd0ca4e and project e916473814d44ac1ae6339f0d052daa1. Resources: {'key_pairs'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:20:48.649004 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-aec0e71c-4ae8-44eb-820b-40aa3318663d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.175501 May 25 16:20:48.656011 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 15/26] 10.222.0.42 () {62 vars in 1199 bytes} [Wed May 25 16:20:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1184 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 25 16:20:48.678054 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-d75609f7-4e2f-472a-b173-f4b42cb45bd3 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:48.678876 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-d75609f7-4e2f-472a-b173-f4b42cb45bd3 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:48.696986 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d75609f7-4e2f-472a-b173-f4b42cb45bd3 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:48.697651 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d75609f7-4e2f-472a-b173-f4b42cb45bd3 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:48.699274 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d75609f7-4e2f-472a-b173-f4b42cb45bd3 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:48.699916 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d75609f7-4e2f-472a-b173-f4b42cb45bd3 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:48.917544 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.network.neutron [None req-ba18a338-a7e9-4aea-9f66-ff4d0b4ebf42 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] validate_networks() for [('c47b68ec-cf9c-457c-8d2b-ef3d80fa25c9', None, None, None, None, None)] {{(pid=117509) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:20:49.078703 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-d75609f7-4e2f-472a-b173-f4b42cb45bd3 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18cd966ad655466e85930f7c505fb360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5ee0d2e59647dc98721de1b8dfb4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:49.090687 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-d75609f7-4e2f-472a-b173-f4b42cb45bd3 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 200 len: 1314 microversion: 2.1 time: 0.433482 May 25 16:20:49.102338 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 16/27] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:48 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:49.111519 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-7a65a71c-1bc2-4aa9-9cec-2b7d6768cff4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-969318777", "imageRef": "e74cccc1-cd1b-4dfc-8e47-3e4a832649a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:20:49.198894 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.network.neutron [None req-7a65a71c-1bc2-4aa9-9cec-2b7d6768cff4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] validate_networks() for [('07eab40d-bc82-4433-9d88-2c85f65e23df', None, None, None, None, None)] {{(pid=117510) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:20:50.418238 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-ba18a338-a7e9-4aea-9f66-ff4d0b4ebf42 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Flavor limits 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:20:50.419273 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-ba18a338-a7e9-4aea-9f66-ff4d0b4ebf42 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Image limits 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:20:50.420055 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-ba18a338-a7e9-4aea-9f66-ff4d0b4ebf42 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Flavor pref 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:20:50.420635 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-ba18a338-a7e9-4aea-9f66-ff4d0b4ebf42 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Image pref 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:20:50.421194 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-ba18a338-a7e9-4aea-9f66-ff4d0b4ebf42 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:20:50.455966 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ba18a338-a7e9-4aea-9f66-ff4d0b4ebf42 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:50.457875 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ba18a338-a7e9-4aea-9f66-ff4d0b4ebf42 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:50.460446 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ba18a338-a7e9-4aea-9f66-ff4d0b4ebf42 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:50.468725 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ba18a338-a7e9-4aea-9f66-ff4d0b4ebf42 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:50.502865 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-ba18a338-a7e9-4aea-9f66-ff4d0b4ebf42 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Getting quotas for project 3e8c39550e4e41e79cc56aa7d22ae052. Resources: {'ram', 'cores', 'instances'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:20:50.511549 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-ba18a338-a7e9-4aea-9f66-ff4d0b4ebf42 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Getting quotas for user 15fae427f22d476fa0e378949de41292 and project 3e8c39550e4e41e79cc56aa7d22ae052. Resources: {'ram', 'cores', 'instances'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:20:50.545214 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-7a65a71c-1bc2-4aa9-9cec-2b7d6768cff4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Flavor limits 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:20:50.546342 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-7a65a71c-1bc2-4aa9-9cec-2b7d6768cff4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Image limits 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:20:50.546992 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-7a65a71c-1bc2-4aa9-9cec-2b7d6768cff4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Flavor pref 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:20:50.547561 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-7a65a71c-1bc2-4aa9-9cec-2b7d6768cff4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Image pref 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:20:50.548144 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-7a65a71c-1bc2-4aa9-9cec-2b7d6768cff4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:20:50.560996 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-ba18a338-a7e9-4aea-9f66-ff4d0b4ebf42 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Going to run 1 instances... {{(pid=117509) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:20:50.565003 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-ba18a338-a7e9-4aea-9f66-ff4d0b4ebf42 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e74cccc1-cd1b-4dfc-8e47-3e4a832649a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:20:50.578263 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7a65a71c-1bc2-4aa9-9cec-2b7d6768cff4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:50.582466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7a65a71c-1bc2-4aa9-9cec-2b7d6768cff4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:50.584738 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7a65a71c-1bc2-4aa9-9cec-2b7d6768cff4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:50.585387 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7a65a71c-1bc2-4aa9-9cec-2b7d6768cff4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:50.647230 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-7a65a71c-1bc2-4aa9-9cec-2b7d6768cff4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Getting quotas for project 95d1e25b20a146c198dfeda0dc43cd72. Resources: {'ram', 'cores', 'instances'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:20:50.656216 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-ba18a338-a7e9-4aea-9f66-ff4d0b4ebf42 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.127193 May 25 16:20:50.657226 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 12/28] 10.222.0.42 () {60 vars in 1146 bytes} [Wed May 25 16:20:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 2129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:20:50.661136 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-7a65a71c-1bc2-4aa9-9cec-2b7d6768cff4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Getting quotas for user 30de794b71b343289491531dfbe37f53 and project 95d1e25b20a146c198dfeda0dc43cd72. Resources: {'ram', 'cores', 'instances'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:20:50.669448 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-4903e0f3-ac17-4ec9-a792-8a310f20c5f2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:50.671629 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-4903e0f3-ac17-4ec9-a792-8a310f20c5f2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:50.687695 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4903e0f3-ac17-4ec9-a792-8a310f20c5f2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:50.689751 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4903e0f3-ac17-4ec9-a792-8a310f20c5f2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:50.690998 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4903e0f3-ac17-4ec9-a792-8a310f20c5f2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:50.694197 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4903e0f3-ac17-4ec9-a792-8a310f20c5f2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:50.731148 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-7a65a71c-1bc2-4aa9-9cec-2b7d6768cff4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Going to run 1 instances... {{(pid=117510) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:20:50.763509 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-7a65a71c-1bc2-4aa9-9cec-2b7d6768cff4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e74cccc1-cd1b-4dfc-8e47-3e4a832649a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:20:50.907823 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-7a65a71c-1bc2-4aa9-9cec-2b7d6768cff4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.800298 May 25 16:20:50.919407 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 17/29] 10.222.0.42 () {60 vars in 1146 bytes} [Wed May 25 16:20:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 1812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:20:50.927557 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-8219803d-f509-4d91-83be-52af1f19cebd tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:50.932638 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-8219803d-f509-4d91-83be-52af1f19cebd tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:50.960960 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8219803d-f509-4d91-83be-52af1f19cebd tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:50.961963 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8219803d-f509-4d91-83be-52af1f19cebd tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:50.963414 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8219803d-f509-4d91-83be-52af1f19cebd tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:50.964080 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8219803d-f509-4d91-83be-52af1f19cebd tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:51.699143 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-4903e0f3-ac17-4ec9-a792-8a310f20c5f2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:51.708786 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-4903e0f3-ac17-4ec9-a792-8a310f20c5f2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98" status: 200 len: 1294 microversion: 2.1 time: 1.049488 May 25 16:20:51.722841 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 13/30] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:50 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 => generated 1294 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:51.722841 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-84e24ebb-2ed8-4985-bf67-1d01a619c073 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:51.722841 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-84e24ebb-2ed8-4985-bf67-1d01a619c073 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:51.864991 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-84e24ebb-2ed8-4985-bf67-1d01a619c073 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:51.873817 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-84e24ebb-2ed8-4985-bf67-1d01a619c073 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1237 microversion: 2.1 time: 0.156828 May 25 16:20:51.877216 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 14/31] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:51 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1237 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:51.891466 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-43aa3bf9-9897-4237-bf63-c1c09189bde6 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:51.892536 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-43aa3bf9-9897-4237-bf63-c1c09189bde6 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:51.942217 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-8219803d-f509-4d91-83be-52af1f19cebd tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18cd966ad655466e85930f7c505fb360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5ee0d2e59647dc98721de1b8dfb4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:51.954351 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-8219803d-f509-4d91-83be-52af1f19cebd tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 200 len: 1314 microversion: 2.1 time: 1.031491 May 25 16:20:51.956925 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 18/32] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:50 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 1314 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:52.147309 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-43aa3bf9-9897-4237-bf63-c1c09189bde6 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:52.157237 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-43aa3bf9-9897-4237-bf63-c1c09189bde6 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1221 microversion: 2.1 time: 0.278675 May 25 16:20:52.162423 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 15/33] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:51 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1221 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:52.735740 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-0d6d7ef5-37de-4a61-b743-8a657b06af84 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:52.736367 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-0d6d7ef5-37de-4a61-b743-8a657b06af84 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:52.746953 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0d6d7ef5-37de-4a61-b743-8a657b06af84 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:52.747420 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0d6d7ef5-37de-4a61-b743-8a657b06af84 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:52.756250 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0d6d7ef5-37de-4a61-b743-8a657b06af84 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:52.757007 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0d6d7ef5-37de-4a61-b743-8a657b06af84 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:52.898605 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-286120c0-33c2-4821-8e71-569b73796598 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:52.900356 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-286120c0-33c2-4821-8e71-569b73796598 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:52.910126 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=10 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:20:52.916119 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-286120c0-33c2-4821-8e71-569b73796598 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:52.917451 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-286120c0-33c2-4821-8e71-569b73796598 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:52.918563 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-286120c0-33c2-4821-8e71-569b73796598 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:52.919413 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-286120c0-33c2-4821-8e71-569b73796598 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:52.926002 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=43 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:20:53.154547 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-286120c0-33c2-4821-8e71-569b73796598 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:53.182491 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-286120c0-33c2-4821-8e71-569b73796598 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1289 microversion: 2.1 time: 0.292000 May 25 16:20:53.194693 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 16/34] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:52 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1289 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:53.202903 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-0d6d7ef5-37de-4a61-b743-8a657b06af84 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:53.204923 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-fc23d208-d264-4ef1-9259-13403821e9e5 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:53.205845 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-fc23d208-d264-4ef1-9259-13403821e9e5 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:53.214063 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fc23d208-d264-4ef1-9259-13403821e9e5 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:53.214945 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fc23d208-d264-4ef1-9259-13403821e9e5 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:53.215137 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-0d6d7ef5-37de-4a61-b743-8a657b06af84 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98" status: 200 len: 1368 microversion: 2.1 time: 0.484173 May 25 16:20:53.216007 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fc23d208-d264-4ef1-9259-13403821e9e5 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:53.218183 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 19/35] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:52 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 => generated 1368 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:53.226133 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fc23d208-d264-4ef1-9259-13403821e9e5 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:53.230288 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-54d0621d-346a-49b9-b3ad-d0c80f89cce0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:53.233925 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-54d0621d-346a-49b9-b3ad-d0c80f89cce0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:53.240980 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-54d0621d-346a-49b9-b3ad-d0c80f89cce0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:53.241951 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-54d0621d-346a-49b9-b3ad-d0c80f89cce0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:53.242979 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-54d0621d-346a-49b9-b3ad-d0c80f89cce0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:53.244013 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-54d0621d-346a-49b9-b3ad-d0c80f89cce0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:53.325898 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-54d0621d-346a-49b9-b3ad-d0c80f89cce0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:53.343735 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-54d0621d-346a-49b9-b3ad-d0c80f89cce0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1273 microversion: 2.1 time: 0.123988 May 25 16:20:53.357821 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 20/36] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:53 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1273 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:53.446376 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-fc23d208-d264-4ef1-9259-13403821e9e5 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18cd966ad655466e85930f7c505fb360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5ee0d2e59647dc98721de1b8dfb4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:53.456117 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-fc23d208-d264-4ef1-9259-13403821e9e5 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 200 len: 1314 microversion: 2.1 time: 0.258838 May 25 16:20:53.457664 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 17/37] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:53 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:54.200859 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-e5fe8860-028c-42b2-a562-24f57d20bb03 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:54.201477 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-e5fe8860-028c-42b2-a562-24f57d20bb03 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:54.209910 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e5fe8860-028c-42b2-a562-24f57d20bb03 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:54.210492 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e5fe8860-028c-42b2-a562-24f57d20bb03 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:54.211165 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e5fe8860-028c-42b2-a562-24f57d20bb03 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:54.211608 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e5fe8860-028c-42b2-a562-24f57d20bb03 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:54.215547 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-40194cd2-fee6-4f2c-a841-71cb8521a660 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-124364133", "imageRef": "e74cccc1-cd1b-4dfc-8e47-3e4a832649a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b9fb8be-8c67-427e-8c91-a4becd42df59"}], "security_groups": [{"name": "tempest-securitygroup--755697654"}], "key_name": "tempest-keypair-456065417", "user_data": "}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:20:54.298562 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-e5fe8860-028c-42b2-a562-24f57d20bb03 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:54.307524 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-e5fe8860-028c-42b2-a562-24f57d20bb03 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1297 microversion: 2.1 time: 0.111127 May 25 16:20:54.308113 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 21/38] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:54 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1297 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:54.314486 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-05118fea-82bf-4fbe-849d-9b4f67e77576 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:54.315732 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-05118fea-82bf-4fbe-849d-9b4f67e77576 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:54.323141 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-05118fea-82bf-4fbe-849d-9b4f67e77576 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:54.323810 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-05118fea-82bf-4fbe-849d-9b4f67e77576 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:54.324580 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-05118fea-82bf-4fbe-849d-9b4f67e77576 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:54.325017 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-05118fea-82bf-4fbe-849d-9b4f67e77576 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:54.347248 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.network.neutron [None req-40194cd2-fee6-4f2c-a841-71cb8521a660 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] validate_networks() for [('4b9fb8be-8c67-427e-8c91-a4becd42df59', None, None, None, None, None)] {{(pid=117509) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:20:54.591322 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-05118fea-82bf-4fbe-849d-9b4f67e77576 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:54.598903 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-05118fea-82bf-4fbe-849d-9b4f67e77576 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98" status: 200 len: 1368 microversion: 2.1 time: 0.289517 May 25 16:20:54.609380 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 22/39] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:54 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 => generated 1368 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:54.609380 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-66f26ebc-c4a7-4de8-a31a-5572974bce75 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:54.609380 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-66f26ebc-c4a7-4de8-a31a-5572974bce75 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:54.615029 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-66f26ebc-c4a7-4de8-a31a-5572974bce75 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:54.615509 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-66f26ebc-c4a7-4de8-a31a-5572974bce75 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:54.616484 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-66f26ebc-c4a7-4de8-a31a-5572974bce75 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:54.616943 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-66f26ebc-c4a7-4de8-a31a-5572974bce75 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:54.708342 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-66f26ebc-c4a7-4de8-a31a-5572974bce75 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:54.716567 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-66f26ebc-c4a7-4de8-a31a-5572974bce75 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1273 microversion: 2.1 time: 0.115309 May 25 16:20:54.717152 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 23/40] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:54 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1273 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:54.722001 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-a48a8add-2a8d-4dfb-82b4-db8c4afeedf3 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:54.722694 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-a48a8add-2a8d-4dfb-82b4-db8c4afeedf3 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:54.728699 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a48a8add-2a8d-4dfb-82b4-db8c4afeedf3 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:54.729338 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a48a8add-2a8d-4dfb-82b4-db8c4afeedf3 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:54.730940 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a48a8add-2a8d-4dfb-82b4-db8c4afeedf3 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:54.731384 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a48a8add-2a8d-4dfb-82b4-db8c4afeedf3 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:54.955668 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-a48a8add-2a8d-4dfb-82b4-db8c4afeedf3 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18cd966ad655466e85930f7c505fb360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5ee0d2e59647dc98721de1b8dfb4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:54.958626 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-40194cd2-fee6-4f2c-a841-71cb8521a660 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Flavor limits 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:20:54.959210 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-40194cd2-fee6-4f2c-a841-71cb8521a660 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Image limits 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:20:54.960074 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-40194cd2-fee6-4f2c-a841-71cb8521a660 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Flavor pref 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:20:54.960489 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-40194cd2-fee6-4f2c-a841-71cb8521a660 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Image pref 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:20:54.960903 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-40194cd2-fee6-4f2c-a841-71cb8521a660 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:20:54.963844 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-a48a8add-2a8d-4dfb-82b4-db8c4afeedf3 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 200 len: 1314 microversion: 2.1 time: 0.245427 May 25 16:20:54.964837 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 24/41] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:54 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:54.970622 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-40194cd2-fee6-4f2c-a841-71cb8521a660 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:54.971070 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-40194cd2-fee6-4f2c-a841-71cb8521a660 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:54.971904 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-40194cd2-fee6-4f2c-a841-71cb8521a660 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:54.972327 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-40194cd2-fee6-4f2c-a841-71cb8521a660 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:54.992375 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-40194cd2-fee6-4f2c-a841-71cb8521a660 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Getting quotas for project e916473814d44ac1ae6339f0d052daa1. Resources: {'ram', 'cores', 'instances'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:20:54.996742 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-40194cd2-fee6-4f2c-a841-71cb8521a660 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Getting quotas for user 9178e89a790d48d19b25c4c22bd0ca4e and project e916473814d44ac1ae6339f0d052daa1. Resources: {'ram', 'cores', 'instances'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:20:55.007647 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-40194cd2-fee6-4f2c-a841-71cb8521a660 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Going to run 1 instances... {{(pid=117509) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:20:55.009956 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-40194cd2-fee6-4f2c-a841-71cb8521a660 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e74cccc1-cd1b-4dfc-8e47-3e4a832649a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:20:55.057653 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-40194cd2-fee6-4f2c-a841-71cb8521a660 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.846338 May 25 16:20:55.058598 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 18/42] 10.222.0.42 () {62 vars in 1187 bytes} [Wed May 25 16:20:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 25 16:20:55.068474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-aed137c4-669b-44ab-8b6c-5ac72218be6c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:55.069091 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-aed137c4-669b-44ab-8b6c-5ac72218be6c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:55.138659 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-aed137c4-669b-44ab-8b6c-5ac72218be6c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:55.148381 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-aed137c4-669b-44ab-8b6c-5ac72218be6c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:55.151174 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-aed137c4-669b-44ab-8b6c-5ac72218be6c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:55.152621 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-aed137c4-669b-44ab-8b6c-5ac72218be6c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1280 microversion: 2.20 time: 0.087842 May 25 16:20:55.162299 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 25/43] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:20:55 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:20:55.325758 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-625d1a19-7575-4f39-988d-5d3fc67c1d68 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:55.326968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-625d1a19-7575-4f39-988d-5d3fc67c1d68 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:55.335639 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-625d1a19-7575-4f39-988d-5d3fc67c1d68 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:55.336341 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-625d1a19-7575-4f39-988d-5d3fc67c1d68 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:55.338798 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-625d1a19-7575-4f39-988d-5d3fc67c1d68 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:55.340132 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-625d1a19-7575-4f39-988d-5d3fc67c1d68 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:55.413944 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-625d1a19-7575-4f39-988d-5d3fc67c1d68 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:55.422279 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-625d1a19-7575-4f39-988d-5d3fc67c1d68 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1297 microversion: 2.1 time: 0.101529 May 25 16:20:55.423013 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 19/44] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:55 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1297 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:55.617037 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-f745e34e-fada-4657-990e-105036a22467 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:55.619531 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-f745e34e-fada-4657-990e-105036a22467 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:55.626981 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f745e34e-fada-4657-990e-105036a22467 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:55.632254 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f745e34e-fada-4657-990e-105036a22467 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:55.633068 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f745e34e-fada-4657-990e-105036a22467 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:55.633540 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f745e34e-fada-4657-990e-105036a22467 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:55.733528 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-9f45c47f-df73-44e0-8efb-53481ea40fa8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:55.734278 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-9f45c47f-df73-44e0-8efb-53481ea40fa8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:55.752700 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9f45c47f-df73-44e0-8efb-53481ea40fa8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:55.753171 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9f45c47f-df73-44e0-8efb-53481ea40fa8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:55.754740 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9f45c47f-df73-44e0-8efb-53481ea40fa8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:55.755570 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9f45c47f-df73-44e0-8efb-53481ea40fa8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:55.970888 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-9f45c47f-df73-44e0-8efb-53481ea40fa8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:55.987786 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-9f45c47f-df73-44e0-8efb-53481ea40fa8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1281 microversion: 2.1 time: 0.258802 May 25 16:20:56.003535 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 20/45] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:55 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1281 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:20:56.014523 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-13c22214-c36d-4198-a670-3268a5b5f914 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:56.015589 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-13c22214-c36d-4198-a670-3268a5b5f914 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:56.028581 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-13c22214-c36d-4198-a670-3268a5b5f914 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:56.029420 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-13c22214-c36d-4198-a670-3268a5b5f914 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:56.030751 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-13c22214-c36d-4198-a670-3268a5b5f914 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:56.031655 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-13c22214-c36d-4198-a670-3268a5b5f914 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:56.352059 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-f745e34e-fada-4657-990e-105036a22467 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:56.363030 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-f745e34e-fada-4657-990e-105036a22467 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98" status: 200 len: 1368 microversion: 2.1 time: 0.750086 May 25 16:20:56.363681 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 26/46] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:55 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 => generated 1368 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:20:56.383952 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-eebe24a3-c56b-4fbb-898f-f0860c48c9dd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:56.387498 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-eebe24a3-c56b-4fbb-898f-f0860c48c9dd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:56.401635 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-eebe24a3-c56b-4fbb-898f-f0860c48c9dd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:56.402370 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-eebe24a3-c56b-4fbb-898f-f0860c48c9dd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:56.403361 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-eebe24a3-c56b-4fbb-898f-f0860c48c9dd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:56.406708 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-eebe24a3-c56b-4fbb-898f-f0860c48c9dd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:56.580099 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-eebe24a3-c56b-4fbb-898f-f0860c48c9dd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:56.604460 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-eebe24a3-c56b-4fbb-898f-f0860c48c9dd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:56.612845 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-eebe24a3-c56b-4fbb-898f-f0860c48c9dd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:56.616538 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-eebe24a3-c56b-4fbb-898f-f0860c48c9dd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1332 microversion: 2.20 time: 0.240592 May 25 16:20:56.617391 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 27/47] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:20:56 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1332 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:20:56.629353 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-dbe825c9-d762-427d-91f2-3ae0a2f49ec6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:56.635735 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-dbe825c9-d762-427d-91f2-3ae0a2f49ec6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:56.653269 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dbe825c9-d762-427d-91f2-3ae0a2f49ec6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:56.666356 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dbe825c9-d762-427d-91f2-3ae0a2f49ec6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:56.667540 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dbe825c9-d762-427d-91f2-3ae0a2f49ec6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:56.668222 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dbe825c9-d762-427d-91f2-3ae0a2f49ec6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:56.741067 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-13c22214-c36d-4198-a670-3268a5b5f914 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18cd966ad655466e85930f7c505fb360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5ee0d2e59647dc98721de1b8dfb4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:56.753273 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-13c22214-c36d-4198-a670-3268a5b5f914 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 200 len: 1314 microversion: 2.1 time: 0.747895 May 25 16:20:56.753965 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 21/48] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:56 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 1314 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:56.799634 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-dbe825c9-d762-427d-91f2-3ae0a2f49ec6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:56.811053 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-dbe825c9-d762-427d-91f2-3ae0a2f49ec6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1295 microversion: 2.1 time: 0.190587 May 25 16:20:56.811794 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 28/49] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:56 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1295 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:57.009177 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-1b637c01-722b-45ec-b6cb-afb464b7bebb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:57.010565 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-1b637c01-722b-45ec-b6cb-afb464b7bebb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:57.025646 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1b637c01-722b-45ec-b6cb-afb464b7bebb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:57.026385 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1b637c01-722b-45ec-b6cb-afb464b7bebb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:57.027325 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1b637c01-722b-45ec-b6cb-afb464b7bebb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:57.028378 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1b637c01-722b-45ec-b6cb-afb464b7bebb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:57.167995 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-1b637c01-722b-45ec-b6cb-afb464b7bebb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:57.176458 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-1b637c01-722b-45ec-b6cb-afb464b7bebb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1279 microversion: 2.1 time: 0.171486 May 25 16:20:57.182037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 22/50] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:57 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1279 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:57.362227 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-de5d7061-3b5c-4472-9ba4-f709e645f9bf req-83320d28-9af9-412b-b418-f1b93843c147 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cebf1f03-8c0a-4aaf-b375-63edcdac9d98", "tag": "a5479e6d-c810-409e-9dcb-42725ffdaeea"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:20:57.377630 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-de5d7061-3b5c-4472-9ba4-f709e645f9bf req-83320d28-9af9-412b-b418-f1b93843c147 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:57.378333 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-de5d7061-3b5c-4472-9ba4-f709e645f9bf req-83320d28-9af9-412b-b418-f1b93843c147 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:57.380581 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-54716a0f-c5cf-4a20-8b3e-7e48dab9e878 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:57.381196 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-54716a0f-c5cf-4a20-8b3e-7e48dab9e878 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:57.394516 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-de5d7061-3b5c-4472-9ba4-f709e645f9bf req-83320d28-9af9-412b-b418-f1b93843c147 service nova] Creating event network-changed:a5479e6d-c810-409e-9dcb-42725ffdaeea for instance cebf1f03-8c0a-4aaf-b375-63edcdac9d98 on hv-cinder-84327 May 25 16:20:57.394979 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-54716a0f-c5cf-4a20-8b3e-7e48dab9e878 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:57.395434 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-54716a0f-c5cf-4a20-8b3e-7e48dab9e878 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:57.396409 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-54716a0f-c5cf-4a20-8b3e-7e48dab9e878 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:57.396781 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-54716a0f-c5cf-4a20-8b3e-7e48dab9e878 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:57.406193 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-de5d7061-3b5c-4472-9ba4-f709e645f9bf req-83320d28-9af9-412b-b418-f1b93843c147 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048235 May 25 16:20:57.408495 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 29/51] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:20:57.645350 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-54716a0f-c5cf-4a20-8b3e-7e48dab9e878 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:57.649081 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-da690b47-9b1d-4bcf-a4a2-af2562461169 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:57.654593 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-da690b47-9b1d-4bcf-a4a2-af2562461169 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:57.655915 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-54716a0f-c5cf-4a20-8b3e-7e48dab9e878 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98" status: 200 len: 1368 microversion: 2.1 time: 0.279063 May 25 16:20:57.657394 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 23/52] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:57 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 => generated 1368 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:57.663492 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-da690b47-9b1d-4bcf-a4a2-af2562461169 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:57.664239 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-da690b47-9b1d-4bcf-a4a2-af2562461169 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:57.666135 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-da690b47-9b1d-4bcf-a4a2-af2562461169 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:57.667083 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-da690b47-9b1d-4bcf-a4a2-af2562461169 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:57.745165 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-da690b47-9b1d-4bcf-a4a2-af2562461169 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:57.748789 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=100 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:20:57.756465 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-da690b47-9b1d-4bcf-a4a2-af2562461169 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:57.758487 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-da690b47-9b1d-4bcf-a4a2-af2562461169 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:57.764407 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-da690b47-9b1d-4bcf-a4a2-af2562461169 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1338 microversion: 2.20 time: 0.124838 May 25 16:20:57.770490 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-39b834f9-2587-4725-950e-b881fdcd3ca5 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:57.776503 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-39b834f9-2587-4725-950e-b881fdcd3ca5 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:57.785216 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 30/53] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:20:57 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1338 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:20:57.787889 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-39b834f9-2587-4725-950e-b881fdcd3ca5 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:57.788730 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-39b834f9-2587-4725-950e-b881fdcd3ca5 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:57.790237 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-39b834f9-2587-4725-950e-b881fdcd3ca5 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:57.790684 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-39b834f9-2587-4725-950e-b881fdcd3ca5 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:57.832543 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-26fd62ea-f1ab-4488-8a7f-4289c985a4cd tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:57.833460 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-26fd62ea-f1ab-4488-8a7f-4289c985a4cd tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:57.840372 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-26fd62ea-f1ab-4488-8a7f-4289c985a4cd tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:57.841063 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-26fd62ea-f1ab-4488-8a7f-4289c985a4cd tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:57.842064 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-26fd62ea-f1ab-4488-8a7f-4289c985a4cd tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:57.842751 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-26fd62ea-f1ab-4488-8a7f-4289c985a4cd tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:57.973071 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-26fd62ea-f1ab-4488-8a7f-4289c985a4cd tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:57.981077 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-39b834f9-2587-4725-950e-b881fdcd3ca5 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18cd966ad655466e85930f7c505fb360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5ee0d2e59647dc98721de1b8dfb4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:57.981876 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-26fd62ea-f1ab-4488-8a7f-4289c985a4cd tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1295 microversion: 2.1 time: 0.156562 May 25 16:20:57.982944 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 31/54] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:57 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1295 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:57.995407 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-39b834f9-2587-4725-950e-b881fdcd3ca5 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 200 len: 1314 microversion: 2.1 time: 0.228654 May 25 16:20:57.996419 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 24/55] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:57 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:20:58.193741 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-529191fa-c8b6-41d9-aef3-fad2e020530a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:58.195060 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-529191fa-c8b6-41d9-aef3-fad2e020530a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:58.204638 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-529191fa-c8b6-41d9-aef3-fad2e020530a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:58.205451 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-529191fa-c8b6-41d9-aef3-fad2e020530a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:58.207419 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-529191fa-c8b6-41d9-aef3-fad2e020530a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:58.208017 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-529191fa-c8b6-41d9-aef3-fad2e020530a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:58.399718 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-529191fa-c8b6-41d9-aef3-fad2e020530a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:58.403045 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-cb8f7816-10dd-4215-abb1-06da7b0f7827 req-a176ef8c-9e5a-42a6-82bf-f0bc22aa7853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68f324c4-3a3e-4e8d-b2ca-91493fae47b1", "tag": "b95684f0-92c8-457d-bd07-c98d017be6fc"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:20:58.407632 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-529191fa-c8b6-41d9-aef3-fad2e020530a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1321 microversion: 2.1 time: 0.219044 May 25 16:20:58.409122 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 32/56] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:58 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:20:58.415628 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-cb8f7816-10dd-4215-abb1-06da7b0f7827 req-a176ef8c-9e5a-42a6-82bf-f0bc22aa7853 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:58.416077 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-cb8f7816-10dd-4215-abb1-06da7b0f7827 req-a176ef8c-9e5a-42a6-82bf-f0bc22aa7853 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:58.438750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-cb8f7816-10dd-4215-abb1-06da7b0f7827 req-a176ef8c-9e5a-42a6-82bf-f0bc22aa7853 service nova] Creating event network-changed:b95684f0-92c8-457d-bd07-c98d017be6fc for instance 68f324c4-3a3e-4e8d-b2ca-91493fae47b1 on hv-cinder-84327 May 25 16:20:58.439122 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-cb8f7816-10dd-4215-abb1-06da7b0f7827 req-a176ef8c-9e5a-42a6-82bf-f0bc22aa7853 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117509) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 25 16:20:58.440448 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1422a970-e5cd-4c06-b521-3beebc6bda5f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:58.440918 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1422a970-e5cd-4c06-b521-3beebc6bda5f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:58.441707 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1422a970-e5cd-4c06-b521-3beebc6bda5f None None] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:58.442167 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1422a970-e5cd-4c06-b521-3beebc6bda5f None None] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:58.452568 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.compute.rpcapi [None req-1422a970-e5cd-4c06-b521-3beebc6bda5f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 25 16:20:58.453464 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1422a970-e5cd-4c06-b521-3beebc6bda5f None None] Releasing lock "compute-rpcapi-router" {{(pid=117509) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 25 16:20:58.473010 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-1422a970-e5cd-4c06-b521-3beebc6bda5f None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146195 May 25 16:20:58.473965 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 25/57] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:20:58.674592 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-495a75f6-33ca-4922-96ac-94d5efffd4c4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:58.675206 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-495a75f6-33ca-4922-96ac-94d5efffd4c4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:58.681285 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-495a75f6-33ca-4922-96ac-94d5efffd4c4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:58.681764 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-495a75f6-33ca-4922-96ac-94d5efffd4c4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:58.682529 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-495a75f6-33ca-4922-96ac-94d5efffd4c4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:58.682967 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-495a75f6-33ca-4922-96ac-94d5efffd4c4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:58.807090 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-f3c41df3-13fe-48ac-be03-d17fb8259e97 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:58.807812 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-f3c41df3-13fe-48ac-be03-d17fb8259e97 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:58.809359 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-495a75f6-33ca-4922-96ac-94d5efffd4c4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:58.814110 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f3c41df3-13fe-48ac-be03-d17fb8259e97 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:58.814552 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f3c41df3-13fe-48ac-be03-d17fb8259e97 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:58.815311 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f3c41df3-13fe-48ac-be03-d17fb8259e97 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:58.815741 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f3c41df3-13fe-48ac-be03-d17fb8259e97 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:58.816802 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-495a75f6-33ca-4922-96ac-94d5efffd4c4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98" status: 200 len: 1368 microversion: 2.1 time: 0.146067 May 25 16:20:58.817368 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 33/58] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:58 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:58.876807 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-f3c41df3-13fe-48ac-be03-d17fb8259e97 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:58.885001 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-f3c41df3-13fe-48ac-be03-d17fb8259e97 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:58.886540 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-f3c41df3-13fe-48ac-be03-d17fb8259e97 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:58.887619 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-f3c41df3-13fe-48ac-be03-d17fb8259e97 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1338 microversion: 2.20 time: 0.085146 May 25 16:20:58.888174 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 26/59] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:20:58 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1338 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:20:58.999294 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-70052931-0848-4c1c-b122-0426b9f9bdcb tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:58.999902 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-70052931-0848-4c1c-b122-0426b9f9bdcb tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:59.005925 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-70052931-0848-4c1c-b122-0426b9f9bdcb tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:59.006321 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-70052931-0848-4c1c-b122-0426b9f9bdcb tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:59.007156 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-70052931-0848-4c1c-b122-0426b9f9bdcb tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:59.007598 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-70052931-0848-4c1c-b122-0426b9f9bdcb tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:59.012729 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-3208b0f2-fcae-4d51-b73a-524c41148cfd tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:59.013348 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-3208b0f2-fcae-4d51-b73a-524c41148cfd tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:59.019283 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3208b0f2-fcae-4d51-b73a-524c41148cfd tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:59.019731 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3208b0f2-fcae-4d51-b73a-524c41148cfd tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:59.020492 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3208b0f2-fcae-4d51-b73a-524c41148cfd tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:59.020926 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3208b0f2-fcae-4d51-b73a-524c41148cfd tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:59.073147 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-70052931-0848-4c1c-b122-0426b9f9bdcb tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:59.081383 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-70052931-0848-4c1c-b122-0426b9f9bdcb tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1295 microversion: 2.1 time: 0.085867 May 25 16:20:59.082309 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 34/60] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:58 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1295 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:59.167775 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-3208b0f2-fcae-4d51-b73a-524c41148cfd tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18cd966ad655466e85930f7c505fb360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5ee0d2e59647dc98721de1b8dfb4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:59.189098 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-3208b0f2-fcae-4d51-b73a-524c41148cfd tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 200 len: 1314 microversion: 2.1 time: 0.180716 May 25 16:20:59.192953 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 27/61] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:59 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:20:59.429415 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-609bf1c3-1c36-4f35-b854-27d8f17fa296 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:59.431415 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-609bf1c3-1c36-4f35-b854-27d8f17fa296 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:59.442475 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-609bf1c3-1c36-4f35-b854-27d8f17fa296 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:59.443203 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-609bf1c3-1c36-4f35-b854-27d8f17fa296 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:59.444231 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-609bf1c3-1c36-4f35-b854-27d8f17fa296 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:59.444894 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-609bf1c3-1c36-4f35-b854-27d8f17fa296 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:59.894979 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-33f8388b-1742-40d9-8aa1-535ce302a062 req-664152fb-530f-40a9-a709-d56e820a335b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f33f1186-4082-43e1-878c-77a547575727", "name": "network-vif-plugged", "status": "completed", "tag": "896b3b44-139e-492c-954c-cf69765ec184"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:20:59.906038 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-33f8388b-1742-40d9-8aa1-535ce302a062 req-664152fb-530f-40a9-a709-d56e820a335b service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:59.906775 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-33f8388b-1742-40d9-8aa1-535ce302a062 req-664152fb-530f-40a9-a709-d56e820a335b service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:59.924556 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-33f8388b-1742-40d9-8aa1-535ce302a062 req-664152fb-530f-40a9-a709-d56e820a335b service nova] Creating event network-vif-plugged:896b3b44-139e-492c-954c-cf69765ec184 for instance f33f1186-4082-43e1-878c-77a547575727 on hv-cinder-84327 May 25 16:20:59.927141 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-609bf1c3-1c36-4f35-b854-27d8f17fa296 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:20:59.931326 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-33f8388b-1742-40d9-8aa1-535ce302a062 req-664152fb-530f-40a9-a709-d56e820a335b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137225 May 25 16:20:59.932252 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 28/62] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:20:59.939580 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-3e2827f2-67f5-4de0-8d22-5888860d9ce4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:59.940589 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-3e2827f2-67f5-4de0-8d22-5888860d9ce4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:59.944123 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-609bf1c3-1c36-4f35-b854-27d8f17fa296 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1321 microversion: 2.1 time: 0.520868 May 25 16:20:59.945403 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 35/63] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:59 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1321 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:20:59.948006 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3e2827f2-67f5-4de0-8d22-5888860d9ce4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:59.948657 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3e2827f2-67f5-4de0-8d22-5888860d9ce4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:59.950588 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3e2827f2-67f5-4de0-8d22-5888860d9ce4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:59.951311 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3e2827f2-67f5-4de0-8d22-5888860d9ce4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:59.951709 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-acb5af09-4eb8-45e4-8977-72ddab032337 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:20:59.952382 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-acb5af09-4eb8-45e4-8977-72ddab032337 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:20:59.961506 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-acb5af09-4eb8-45e4-8977-72ddab032337 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:59.962232 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-acb5af09-4eb8-45e4-8977-72ddab032337 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:20:59.963209 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-acb5af09-4eb8-45e4-8977-72ddab032337 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:20:59.963869 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-acb5af09-4eb8-45e4-8977-72ddab032337 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:00.139011 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-acb5af09-4eb8-45e4-8977-72ddab032337 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:00.155851 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-acb5af09-4eb8-45e4-8977-72ddab032337 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:00.167094 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-acb5af09-4eb8-45e4-8977-72ddab032337 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:00.169309 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-acb5af09-4eb8-45e4-8977-72ddab032337 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1338 microversion: 2.20 time: 0.222291 May 25 16:21:00.173572 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 36/64] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:20:59 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1338 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:21:00.184925 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-72c1447e-971f-494a-8800-7aa0c1928a0a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:00.187369 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-72c1447e-971f-494a-8800-7aa0c1928a0a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:00.209899 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-72c1447e-971f-494a-8800-7aa0c1928a0a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:00.212233 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-72c1447e-971f-494a-8800-7aa0c1928a0a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:00.215799 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-72c1447e-971f-494a-8800-7aa0c1928a0a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:00.217430 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-72c1447e-971f-494a-8800-7aa0c1928a0a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:00.444479 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-72c1447e-971f-494a-8800-7aa0c1928a0a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:00.454698 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-3e2827f2-67f5-4de0-8d22-5888860d9ce4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:00.459669 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-72c1447e-971f-494a-8800-7aa0c1928a0a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1295 microversion: 2.1 time: 0.283101 May 25 16:21:00.460393 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 37/65] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:00 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1295 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:00.466333 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-3e2827f2-67f5-4de0-8d22-5888860d9ce4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98" status: 200 len: 1368 microversion: 2.1 time: 0.532618 May 25 16:21:00.471477 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-810eed7c-5237-4235-9fbf-e57c30e0e532 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:00.472433 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-810eed7c-5237-4235-9fbf-e57c30e0e532 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:00.478446 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 29/66] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:20:59 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 => generated 1368 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:00.492096 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-810eed7c-5237-4235-9fbf-e57c30e0e532 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:00.493415 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-810eed7c-5237-4235-9fbf-e57c30e0e532 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:00.495849 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-810eed7c-5237-4235-9fbf-e57c30e0e532 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:00.496531 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-810eed7c-5237-4235-9fbf-e57c30e0e532 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:00.608788 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell0:SELECT=6 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:21:00.861560 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-810eed7c-5237-4235-9fbf-e57c30e0e532 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18cd966ad655466e85930f7c505fb360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5ee0d2e59647dc98721de1b8dfb4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:00.873500 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-810eed7c-5237-4235-9fbf-e57c30e0e532 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 200 len: 1314 microversion: 2.1 time: 0.408399 May 25 16:21:00.874897 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 38/67] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:00 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:00.961245 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-596dd057-1a1e-4b5a-ae07-ed2ffc7b180f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:00.962258 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-596dd057-1a1e-4b5a-ae07-ed2ffc7b180f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:00.970576 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-596dd057-1a1e-4b5a-ae07-ed2ffc7b180f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:00.971027 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-596dd057-1a1e-4b5a-ae07-ed2ffc7b180f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:00.971794 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-596dd057-1a1e-4b5a-ae07-ed2ffc7b180f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:00.972231 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-596dd057-1a1e-4b5a-ae07-ed2ffc7b180f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:01.120799 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-596dd057-1a1e-4b5a-ae07-ed2ffc7b180f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:01.128450 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-596dd057-1a1e-4b5a-ae07-ed2ffc7b180f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1321 microversion: 2.1 time: 0.171257 May 25 16:21:01.129146 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 30/68] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:00 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:01.194273 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-6dfb4492-18fc-4aaf-a598-20c14c488e52 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:01.194878 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-6dfb4492-18fc-4aaf-a598-20c14c488e52 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:01.201611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6dfb4492-18fc-4aaf-a598-20c14c488e52 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:01.202184 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6dfb4492-18fc-4aaf-a598-20c14c488e52 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:01.203028 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6dfb4492-18fc-4aaf-a598-20c14c488e52 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:01.203552 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6dfb4492-18fc-4aaf-a598-20c14c488e52 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:01.272242 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-6dfb4492-18fc-4aaf-a598-20c14c488e52 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:01.281068 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-6dfb4492-18fc-4aaf-a598-20c14c488e52 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:01.282686 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-6dfb4492-18fc-4aaf-a598-20c14c488e52 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:01.283859 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-6dfb4492-18fc-4aaf-a598-20c14c488e52 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1338 microversion: 2.20 time: 0.093529 May 25 16:21:01.284497 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 39/69] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:21:01 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1338 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:21:01.479652 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-e08efe93-8208-4500-9acb-5f4c557e4686 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:01.480960 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-e08efe93-8208-4500-9acb-5f4c557e4686 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:01.485017 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-f4a4e60c-e9a1-4faa-94da-3d50ed25099c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:01.485733 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-f4a4e60c-e9a1-4faa-94da-3d50ed25099c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:01.488141 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e08efe93-8208-4500-9acb-5f4c557e4686 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:01.488671 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e08efe93-8208-4500-9acb-5f4c557e4686 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:01.489693 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e08efe93-8208-4500-9acb-5f4c557e4686 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:01.490444 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e08efe93-8208-4500-9acb-5f4c557e4686 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:01.495342 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f4a4e60c-e9a1-4faa-94da-3d50ed25099c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:01.498181 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f4a4e60c-e9a1-4faa-94da-3d50ed25099c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:01.499439 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f4a4e60c-e9a1-4faa-94da-3d50ed25099c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:01.500051 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f4a4e60c-e9a1-4faa-94da-3d50ed25099c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:01.719638 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-e08efe93-8208-4500-9acb-5f4c557e4686 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:01.727795 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-e08efe93-8208-4500-9acb-5f4c557e4686 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1363 microversion: 2.1 time: 0.254044 May 25 16:21:01.739151 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 31/70] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:01 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:01.754712 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-f4a4e60c-e9a1-4faa-94da-3d50ed25099c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:01.771806 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-f4a4e60c-e9a1-4faa-94da-3d50ed25099c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98" status: 200 len: 1368 microversion: 2.1 time: 0.291361 May 25 16:21:01.775096 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 40/71] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:01 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 => generated 1368 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:21:01.855463 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-f7c35ba8-d115-46b4-a698-7fd16d7d7376 req-7a5779a8-18d2-41f0-b750-bf9de3abe037 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "756c834d-49bb-4cd7-b5c7-7140c66b0d0c", "tag": "32e483c1-8f09-4e2a-9e95-ef7a5e449743"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:21:01.872878 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-f7c35ba8-d115-46b4-a698-7fd16d7d7376 req-7a5779a8-18d2-41f0-b750-bf9de3abe037 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:01.873316 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-f7c35ba8-d115-46b4-a698-7fd16d7d7376 req-7a5779a8-18d2-41f0-b750-bf9de3abe037 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:01.893574 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-111c4de4-ef79-441d-af7e-65313b7c9d6f tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:01.894317 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-111c4de4-ef79-441d-af7e-65313b7c9d6f tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:01.907436 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-111c4de4-ef79-441d-af7e-65313b7c9d6f tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:01.907888 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-111c4de4-ef79-441d-af7e-65313b7c9d6f tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:01.908666 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-111c4de4-ef79-441d-af7e-65313b7c9d6f tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:01.909234 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-111c4de4-ef79-441d-af7e-65313b7c9d6f tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:01.915116 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-f7c35ba8-d115-46b4-a698-7fd16d7d7376 req-7a5779a8-18d2-41f0-b750-bf9de3abe037 service nova] Creating event network-changed:32e483c1-8f09-4e2a-9e95-ef7a5e449743 for instance 756c834d-49bb-4cd7-b5c7-7140c66b0d0c on hv-cinder-84327 May 25 16:21:01.923546 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-f7c35ba8-d115-46b4-a698-7fd16d7d7376 req-7a5779a8-18d2-41f0-b750-bf9de3abe037 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072080 May 25 16:21:01.925098 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 32/72] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:21:02.086942 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-111c4de4-ef79-441d-af7e-65313b7c9d6f tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18cd966ad655466e85930f7c505fb360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5ee0d2e59647dc98721de1b8dfb4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:02.095360 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-111c4de4-ef79-441d-af7e-65313b7c9d6f tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 200 len: 1314 microversion: 2.1 time: 0.207145 May 25 16:21:02.096256 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 41/73] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:01 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:21:02.148295 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-cd20a863-b1cf-4f1a-afc6-57cfb58c37d5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:02.150233 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-cd20a863-b1cf-4f1a-afc6-57cfb58c37d5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:02.159366 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-cd20a863-b1cf-4f1a-afc6-57cfb58c37d5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:02.159810 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-cd20a863-b1cf-4f1a-afc6-57cfb58c37d5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:02.160571 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-cd20a863-b1cf-4f1a-afc6-57cfb58c37d5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:02.161000 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-cd20a863-b1cf-4f1a-afc6-57cfb58c37d5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:02.302755 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-89dd2950-cef4-4489-9642-0e92b7f5a6e8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:02.303373 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-89dd2950-cef4-4489-9642-0e92b7f5a6e8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:02.307950 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-cd20a863-b1cf-4f1a-afc6-57cfb58c37d5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:02.310037 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-89dd2950-cef4-4489-9642-0e92b7f5a6e8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:02.310594 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-89dd2950-cef4-4489-9642-0e92b7f5a6e8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:02.311601 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-89dd2950-cef4-4489-9642-0e92b7f5a6e8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:02.312368 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-89dd2950-cef4-4489-9642-0e92b7f5a6e8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:02.315413 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-cd20a863-b1cf-4f1a-afc6-57cfb58c37d5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1321 microversion: 2.1 time: 0.172827 May 25 16:21:02.316198 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 33/74] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:02 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:02.449648 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-89dd2950-cef4-4489-9642-0e92b7f5a6e8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:02.458051 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-89dd2950-cef4-4489-9642-0e92b7f5a6e8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:02.459540 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-89dd2950-cef4-4489-9642-0e92b7f5a6e8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:02.461904 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-89dd2950-cef4-4489-9642-0e92b7f5a6e8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1405 microversion: 2.20 time: 0.162312 May 25 16:21:02.462936 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 42/75] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:21:02 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:21:02.744677 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-b8f93d4a-1d46-436e-a704-3bf272a7e386 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:02.745497 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-b8f93d4a-1d46-436e-a704-3bf272a7e386 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:02.753980 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b8f93d4a-1d46-436e-a704-3bf272a7e386 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:02.754428 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b8f93d4a-1d46-436e-a704-3bf272a7e386 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:02.755231 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b8f93d4a-1d46-436e-a704-3bf272a7e386 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:02.755667 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b8f93d4a-1d46-436e-a704-3bf272a7e386 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:02.789453 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-b6fec368-eb51-446e-a166-977f50f73a01 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:02.790182 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-b6fec368-eb51-446e-a166-977f50f73a01 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:02.796245 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b6fec368-eb51-446e-a166-977f50f73a01 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:02.796698 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b6fec368-eb51-446e-a166-977f50f73a01 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:02.797465 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b6fec368-eb51-446e-a166-977f50f73a01 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:02.797936 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b6fec368-eb51-446e-a166-977f50f73a01 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:02.940366 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-b8f93d4a-1d46-436e-a704-3bf272a7e386 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:02.949430 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-b8f93d4a-1d46-436e-a704-3bf272a7e386 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1363 microversion: 2.1 time: 0.208899 May 25 16:21:02.950223 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 34/76] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:02 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:02.964668 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-b6fec368-eb51-446e-a166-977f50f73a01 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:02.972951 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-b6fec368-eb51-446e-a166-977f50f73a01 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98" status: 200 len: 1368 microversion: 2.1 time: 0.187515 May 25 16:21:02.973521 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 43/77] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:02 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:21:03.112228 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-c7eab3e6-a568-4ec1-aa8f-cf7461ee0d33 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:03.112829 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-c7eab3e6-a568-4ec1-aa8f-cf7461ee0d33 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:03.119444 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c7eab3e6-a568-4ec1-aa8f-cf7461ee0d33 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:03.119882 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c7eab3e6-a568-4ec1-aa8f-cf7461ee0d33 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:03.120651 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c7eab3e6-a568-4ec1-aa8f-cf7461ee0d33 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:03.121080 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c7eab3e6-a568-4ec1-aa8f-cf7461ee0d33 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:03.124983 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=100 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:21:03.245094 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-c7eab3e6-a568-4ec1-aa8f-cf7461ee0d33 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18cd966ad655466e85930f7c505fb360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5ee0d2e59647dc98721de1b8dfb4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:03.252690 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-c7eab3e6-a568-4ec1-aa8f-cf7461ee0d33 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 200 len: 1314 microversion: 2.1 time: 0.144279 May 25 16:21:03.253270 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 35/78] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:03 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:03.332383 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-e569e37b-95b7-49c0-a3d2-27510357aefb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:03.332993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-e569e37b-95b7-49c0-a3d2-27510357aefb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:03.339418 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e569e37b-95b7-49c0-a3d2-27510357aefb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:03.339862 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e569e37b-95b7-49c0-a3d2-27510357aefb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:03.340625 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e569e37b-95b7-49c0-a3d2-27510357aefb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:03.341083 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e569e37b-95b7-49c0-a3d2-27510357aefb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:03.466236 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-e569e37b-95b7-49c0-a3d2-27510357aefb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:03.474180 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-e569e37b-95b7-49c0-a3d2-27510357aefb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1321 microversion: 2.1 time: 0.145475 May 25 16:21:03.481790 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 44/79] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:03 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1321 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:03.481929 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-11d2f24b-7ff1-477b-af6e-5da02686cc5a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:03.481929 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-11d2f24b-7ff1-477b-af6e-5da02686cc5a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:03.487277 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-11d2f24b-7ff1-477b-af6e-5da02686cc5a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:03.487798 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-11d2f24b-7ff1-477b-af6e-5da02686cc5a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:03.488559 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-11d2f24b-7ff1-477b-af6e-5da02686cc5a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:03.488996 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-11d2f24b-7ff1-477b-af6e-5da02686cc5a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:03.617458 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-11d2f24b-7ff1-477b-af6e-5da02686cc5a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:03.626731 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-11d2f24b-7ff1-477b-af6e-5da02686cc5a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:03.628222 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-11d2f24b-7ff1-477b-af6e-5da02686cc5a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:03.629318 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-11d2f24b-7ff1-477b-af6e-5da02686cc5a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1405 microversion: 2.20 time: 0.153562 May 25 16:21:03.629938 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 36/80] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:21:03 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:21:03.971431 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-3a89cd1d-b5b6-4bcd-90d0-fb57a5b1a03f tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:03.972986 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-3a89cd1d-b5b6-4bcd-90d0-fb57a5b1a03f tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:03.982317 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3a89cd1d-b5b6-4bcd-90d0-fb57a5b1a03f tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:03.982964 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3a89cd1d-b5b6-4bcd-90d0-fb57a5b1a03f tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:03.983904 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3a89cd1d-b5b6-4bcd-90d0-fb57a5b1a03f tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:03.984480 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3a89cd1d-b5b6-4bcd-90d0-fb57a5b1a03f tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:03.993192 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-6fa06fbe-86ea-419a-99e5-33aaa8876dd0 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:03.994161 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-6fa06fbe-86ea-419a-99e5-33aaa8876dd0 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:04.003829 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6fa06fbe-86ea-419a-99e5-33aaa8876dd0 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:04.004384 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6fa06fbe-86ea-419a-99e5-33aaa8876dd0 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:04.006906 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6fa06fbe-86ea-419a-99e5-33aaa8876dd0 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:04.008219 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6fa06fbe-86ea-419a-99e5-33aaa8876dd0 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:04.280245 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-6fa06fbe-86ea-419a-99e5-33aaa8876dd0 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:04.291609 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-6fa06fbe-86ea-419a-99e5-33aaa8876dd0 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98" status: 200 len: 1368 microversion: 2.1 time: 0.303015 May 25 16:21:04.292403 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 37/81] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:03 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 => generated 1368 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:04.299481 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-c7ac8781-beed-4779-82b5-9884b7ce10bf tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:04.300324 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-c7ac8781-beed-4779-82b5-9884b7ce10bf tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:04.312445 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-3a89cd1d-b5b6-4bcd-90d0-fb57a5b1a03f tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:04.313219 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c7ac8781-beed-4779-82b5-9884b7ce10bf tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:04.313944 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c7ac8781-beed-4779-82b5-9884b7ce10bf tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:04.314461 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c7ac8781-beed-4779-82b5-9884b7ce10bf tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:04.314948 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c7ac8781-beed-4779-82b5-9884b7ce10bf tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:04.336234 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-3a89cd1d-b5b6-4bcd-90d0-fb57a5b1a03f tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1363 microversion: 2.1 time: 0.369508 May 25 16:21:04.345144 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 45/82] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:03 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1363 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:04.492723 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-617e37e7-3ddb-4ba5-ac11-0ed4f716d7bc tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:04.494216 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-617e37e7-3ddb-4ba5-ac11-0ed4f716d7bc tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:04.502065 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-617e37e7-3ddb-4ba5-ac11-0ed4f716d7bc tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:04.503083 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-617e37e7-3ddb-4ba5-ac11-0ed4f716d7bc tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:04.504253 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-617e37e7-3ddb-4ba5-ac11-0ed4f716d7bc tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:04.504923 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-617e37e7-3ddb-4ba5-ac11-0ed4f716d7bc tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:04.559613 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-c7ac8781-beed-4779-82b5-9884b7ce10bf tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18cd966ad655466e85930f7c505fb360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5ee0d2e59647dc98721de1b8dfb4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:04.570451 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-c7ac8781-beed-4779-82b5-9884b7ce10bf tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 200 len: 1314 microversion: 2.1 time: 0.275757 May 25 16:21:04.572999 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 38/83] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:04 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:04.648686 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-dc4908cd-0d6d-4eb4-b49f-8b90f27d7ab5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:04.649899 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-dc4908cd-0d6d-4eb4-b49f-8b90f27d7ab5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:04.665637 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dc4908cd-0d6d-4eb4-b49f-8b90f27d7ab5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:04.670069 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dc4908cd-0d6d-4eb4-b49f-8b90f27d7ab5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:04.671072 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dc4908cd-0d6d-4eb4-b49f-8b90f27d7ab5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:04.671664 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dc4908cd-0d6d-4eb4-b49f-8b90f27d7ab5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:04.813481 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-617e37e7-3ddb-4ba5-ac11-0ed4f716d7bc tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:04.828211 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-617e37e7-3ddb-4ba5-ac11-0ed4f716d7bc tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1321 microversion: 2.1 time: 0.338389 May 25 16:21:04.830365 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 46/84] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:04 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1321 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:21:04.993390 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-dc4908cd-0d6d-4eb4-b49f-8b90f27d7ab5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:05.002286 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-dc4908cd-0d6d-4eb4-b49f-8b90f27d7ab5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:05.003994 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-dc4908cd-0d6d-4eb4-b49f-8b90f27d7ab5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:05.005276 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-dc4908cd-0d6d-4eb4-b49f-8b90f27d7ab5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1405 microversion: 2.20 time: 0.360779 May 25 16:21:05.006157 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 39/85] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:21:04 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1405 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:21:05.308586 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-22d8c6f6-00f8-4d33-bd68-a951285a8b5a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:05.309199 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-22d8c6f6-00f8-4d33-bd68-a951285a8b5a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:05.318325 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell0:SELECT=18 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:21:05.320352 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-22d8c6f6-00f8-4d33-bd68-a951285a8b5a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:05.321510 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-22d8c6f6-00f8-4d33-bd68-a951285a8b5a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:05.334902 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-22d8c6f6-00f8-4d33-bd68-a951285a8b5a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:05.335441 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-22d8c6f6-00f8-4d33-bd68-a951285a8b5a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:05.362552 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-3713df99-98b5-4928-89e2-ef7d47e5d4be tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:05.363196 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-3713df99-98b5-4928-89e2-ef7d47e5d4be tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:05.366212 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell0:SELECT=30 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:21:05.381244 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=100 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:21:05.382705 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3713df99-98b5-4928-89e2-ef7d47e5d4be tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:05.383369 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3713df99-98b5-4928-89e2-ef7d47e5d4be tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:05.384318 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3713df99-98b5-4928-89e2-ef7d47e5d4be tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:05.384956 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3713df99-98b5-4928-89e2-ef7d47e5d4be tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:05.682754 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-22d8c6f6-00f8-4d33-bd68-a951285a8b5a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:05.685811 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-3713df99-98b5-4928-89e2-ef7d47e5d4be tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:05.694504 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-22d8c6f6-00f8-4d33-bd68-a951285a8b5a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98" status: 200 len: 1368 microversion: 2.1 time: 0.389846 May 25 16:21:05.694737 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-3713df99-98b5-4928-89e2-ef7d47e5d4be tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1363 microversion: 2.1 time: 0.335800 May 25 16:21:05.695848 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 47/87] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:05 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 => generated 1368 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:05.696102 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 40/87] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:05 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1363 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:05.700330 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-ae72fd1f-3315-48e8-a8c1-2484405492b6 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:05.700930 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-ae72fd1f-3315-48e8-a8c1-2484405492b6 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:05.709701 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ae72fd1f-3315-48e8-a8c1-2484405492b6 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:05.710172 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ae72fd1f-3315-48e8-a8c1-2484405492b6 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:05.711114 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ae72fd1f-3315-48e8-a8c1-2484405492b6 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:05.712069 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ae72fd1f-3315-48e8-a8c1-2484405492b6 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:05.847378 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-48713296-2b36-4e8a-8fcc-255e16444f0c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:05.847993 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-48713296-2b36-4e8a-8fcc-255e16444f0c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:05.854370 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-48713296-2b36-4e8a-8fcc-255e16444f0c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:05.861644 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-48713296-2b36-4e8a-8fcc-255e16444f0c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:05.862484 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-48713296-2b36-4e8a-8fcc-255e16444f0c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:05.863067 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-48713296-2b36-4e8a-8fcc-255e16444f0c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:05.870319 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-ae72fd1f-3315-48e8-a8c1-2484405492b6 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18cd966ad655466e85930f7c505fb360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5ee0d2e59647dc98721de1b8dfb4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:05.900858 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-ae72fd1f-3315-48e8-a8c1-2484405492b6 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 200 len: 1501 microversion: 2.1 time: 0.203995 May 25 16:21:05.903241 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 48/88] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:05 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 1501 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:05.910188 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-b444e025-5f1e-40f2-be54-4a9480f4bc4b req-329c5aad-de27-4f14-8ec7-406db802b9ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c525fad-3e59-4bcd-9263-cf3a13d13e3f", "tag": "5d7ffb26-b14c-4496-a249-7c6754e10040"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:21:05.923949 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-b444e025-5f1e-40f2-be54-4a9480f4bc4b req-329c5aad-de27-4f14-8ec7-406db802b9ec service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:05.925367 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-b444e025-5f1e-40f2-be54-4a9480f4bc4b req-329c5aad-de27-4f14-8ec7-406db802b9ec service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:05.951122 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-b444e025-5f1e-40f2-be54-4a9480f4bc4b req-329c5aad-de27-4f14-8ec7-406db802b9ec service nova] Creating event network-changed:5d7ffb26-b14c-4496-a249-7c6754e10040 for instance 9c525fad-3e59-4bcd-9263-cf3a13d13e3f on hv-cinder-84327 May 25 16:21:05.957178 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-b444e025-5f1e-40f2-be54-4a9480f4bc4b req-329c5aad-de27-4f14-8ec7-406db802b9ec service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051845 May 25 16:21:05.958294 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 49/89] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:21:06.027464 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-a5a78de5-a5fc-4ec3-a0b8-82ae44ded15e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:06.028240 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-a5a78de5-a5fc-4ec3-a0b8-82ae44ded15e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:06.045728 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a5a78de5-a5fc-4ec3-a0b8-82ae44ded15e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:06.048058 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a5a78de5-a5fc-4ec3-a0b8-82ae44ded15e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:06.049074 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a5a78de5-a5fc-4ec3-a0b8-82ae44ded15e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:06.050078 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a5a78de5-a5fc-4ec3-a0b8-82ae44ded15e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:06.210376 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-48713296-2b36-4e8a-8fcc-255e16444f0c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:06.230732 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-48713296-2b36-4e8a-8fcc-255e16444f0c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1321 microversion: 2.1 time: 0.384996 May 25 16:21:06.243062 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 41/90] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:05 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1321 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:06.350564 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-a5a78de5-a5fc-4ec3-a0b8-82ae44ded15e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:06.361073 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-a5a78de5-a5fc-4ec3-a0b8-82ae44ded15e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:06.363217 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-a5a78de5-a5fc-4ec3-a0b8-82ae44ded15e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:06.364780 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-a5a78de5-a5fc-4ec3-a0b8-82ae44ded15e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1405 microversion: 2.20 time: 0.343689 May 25 16:21:06.365954 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 50/91] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:21:06 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1405 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:21:06.717307 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-6eee5512-e693-4fb3-bc07-7290230516e4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:06.718379 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-fe869774-608b-489c-a898-011268c6d6de tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:06.719224 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-6eee5512-e693-4fb3-bc07-7290230516e4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:06.720361 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-fe869774-608b-489c-a898-011268c6d6de tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:06.731658 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fe869774-608b-489c-a898-011268c6d6de tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:06.732400 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fe869774-608b-489c-a898-011268c6d6de tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:06.733690 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fe869774-608b-489c-a898-011268c6d6de tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:06.734829 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fe869774-608b-489c-a898-011268c6d6de tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:06.734967 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6eee5512-e693-4fb3-bc07-7290230516e4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:06.735958 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6eee5512-e693-4fb3-bc07-7290230516e4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:06.738332 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6eee5512-e693-4fb3-bc07-7290230516e4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:06.738793 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6eee5512-e693-4fb3-bc07-7290230516e4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:07.014889 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-6eee5512-e693-4fb3-bc07-7290230516e4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:07.022345 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-6eee5512-e693-4fb3-bc07-7290230516e4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98" status: 200 len: 1368 microversion: 2.1 time: 0.313209 May 25 16:21:07.022926 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 51/92] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:06 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 => generated 1368 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:07.030540 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-fe869774-608b-489c-a898-011268c6d6de tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:07.038549 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-fe869774-608b-489c-a898-011268c6d6de tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1363 microversion: 2.1 time: 0.328953 May 25 16:21:07.039379 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 42/93] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:06 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1363 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:07.248777 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-52cbf0a4-739c-40dc-af91-7971593e6259 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:07.249393 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-52cbf0a4-739c-40dc-af91-7971593e6259 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:07.251355 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:21:07.256283 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-52cbf0a4-739c-40dc-af91-7971593e6259 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:07.256750 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-52cbf0a4-739c-40dc-af91-7971593e6259 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:07.257510 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-52cbf0a4-739c-40dc-af91-7971593e6259 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:07.258595 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-52cbf0a4-739c-40dc-af91-7971593e6259 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:07.391597 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-22743d28-48f4-44a7-90cd-3f132678f1af tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:07.392298 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-22743d28-48f4-44a7-90cd-3f132678f1af tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:07.400406 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-22743d28-48f4-44a7-90cd-3f132678f1af tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:07.400861 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-22743d28-48f4-44a7-90cd-3f132678f1af tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:07.401172 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-52cbf0a4-739c-40dc-af91-7971593e6259 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:07.401627 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-22743d28-48f4-44a7-90cd-3f132678f1af tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:07.402743 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-22743d28-48f4-44a7-90cd-3f132678f1af tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:07.409463 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-52cbf0a4-739c-40dc-af91-7971593e6259 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1321 microversion: 2.1 time: 0.164449 May 25 16:21:07.410180 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 52/94] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:07 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:07.539121 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-22743d28-48f4-44a7-90cd-3f132678f1af tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:07.547517 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-22743d28-48f4-44a7-90cd-3f132678f1af tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:07.549015 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-22743d28-48f4-44a7-90cd-3f132678f1af tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:07.550152 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-22743d28-48f4-44a7-90cd-3f132678f1af tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1405 microversion: 2.20 time: 0.163684 May 25 16:21:07.550876 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 43/95] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:21:07 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:21:07.646791 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-09400d00-a14b-45c8-978b-4a5f8e787aa5 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b3691d7-1593-43a2-af0d-b189d8a6af1a"}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:21:07.647897 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-09400d00-a14b-45c8-978b-4a5f8e787aa5 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:07.656332 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-09400d00-a14b-45c8-978b-4a5f8e787aa5 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:07.656782 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-09400d00-a14b-45c8-978b-4a5f8e787aa5 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:07.657673 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-09400d00-a14b-45c8-978b-4a5f8e787aa5 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:07.658208 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-09400d00-a14b-45c8-978b-4a5f8e787aa5 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:07.992652 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-5c941b83-c51f-4c5e-a656-98a7d27bced2 req-ca2d0ff8-d81b-42c7-a906-3bfa21bde9df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3da72ce-f083-455e-ae40-9530c53126ef", "tag": "81d48be3-f76c-4118-bcaa-79360428da5a"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:21:08.000805 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-5c941b83-c51f-4c5e-a656-98a7d27bced2 req-ca2d0ff8-d81b-42c7-a906-3bfa21bde9df service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:08.001248 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-5c941b83-c51f-4c5e-a656-98a7d27bced2 req-ca2d0ff8-d81b-42c7-a906-3bfa21bde9df service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:08.013266 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-5c941b83-c51f-4c5e-a656-98a7d27bced2 req-ca2d0ff8-d81b-42c7-a906-3bfa21bde9df service nova] Creating event network-changed:81d48be3-f76c-4118-bcaa-79360428da5a for instance d3da72ce-f083-455e-ae40-9530c53126ef on hv-cinder-84327 May 25 16:21:08.018140 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-5c941b83-c51f-4c5e-a656-98a7d27bced2 req-ca2d0ff8-d81b-42c7-a906-3bfa21bde9df service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029221 May 25 16:21:08.018727 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 44/96] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:21:08.040694 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-d663dae6-95eb-4808-aef3-e3dcb07d9935 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:08.041392 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-d663dae6-95eb-4808-aef3-e3dcb07d9935 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:08.047641 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d663dae6-95eb-4808-aef3-e3dcb07d9935 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:08.048089 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d663dae6-95eb-4808-aef3-e3dcb07d9935 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:08.048841 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d663dae6-95eb-4808-aef3-e3dcb07d9935 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:08.049282 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d663dae6-95eb-4808-aef3-e3dcb07d9935 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:08.185949 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-d663dae6-95eb-4808-aef3-e3dcb07d9935 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:08.194779 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-d663dae6-95eb-4808-aef3-e3dcb07d9935 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98" status: 200 len: 1368 microversion: 2.1 time: 0.158652 May 25 16:21:08.196848 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 45/97] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:08 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:21:08.201315 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-4c1ae3f3-281e-4c8b-b60f-028038481a4e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:08.202124 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-4c1ae3f3-281e-4c8b-b60f-028038481a4e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:08.208610 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4c1ae3f3-281e-4c8b-b60f-028038481a4e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:08.208610 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4c1ae3f3-281e-4c8b-b60f-028038481a4e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:08.209160 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4c1ae3f3-281e-4c8b-b60f-028038481a4e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:08.209615 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4c1ae3f3-281e-4c8b-b60f-028038481a4e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:08.344743 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-4c1ae3f3-281e-4c8b-b60f-028038481a4e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:08.352939 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-4c1ae3f3-281e-4c8b-b60f-028038481a4e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1363 microversion: 2.1 time: 0.155123 May 25 16:21:08.353505 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 46/98] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:08 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:08.426348 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-e117f3d9-b509-44a1-9a87-10a4a0b2788e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:08.427394 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-e117f3d9-b509-44a1-9a87-10a4a0b2788e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:08.435815 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e117f3d9-b509-44a1-9a87-10a4a0b2788e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:08.436269 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e117f3d9-b509-44a1-9a87-10a4a0b2788e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:08.437044 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e117f3d9-b509-44a1-9a87-10a4a0b2788e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:08.437484 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e117f3d9-b509-44a1-9a87-10a4a0b2788e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:08.456240 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell0:SELECT=8 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:21:08.578824 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-e117f3d9-b509-44a1-9a87-10a4a0b2788e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:08.587203 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-e117f3d9-b509-44a1-9a87-10a4a0b2788e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1321 microversion: 2.1 time: 0.163912 May 25 16:21:08.587807 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 47/99] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:08 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:21:08.592675 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-90f2d4e7-7e32-44e1-a7a1-04c8fab60980 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:08.593431 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-90f2d4e7-7e32-44e1-a7a1-04c8fab60980 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:08.599346 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-90f2d4e7-7e32-44e1-a7a1-04c8fab60980 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:08.599797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-90f2d4e7-7e32-44e1-a7a1-04c8fab60980 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:08.600551 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-90f2d4e7-7e32-44e1-a7a1-04c8fab60980 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:08.600988 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-90f2d4e7-7e32-44e1-a7a1-04c8fab60980 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:08.735247 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-90f2d4e7-7e32-44e1-a7a1-04c8fab60980 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:08.743765 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-90f2d4e7-7e32-44e1-a7a1-04c8fab60980 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:08.745469 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-90f2d4e7-7e32-44e1-a7a1-04c8fab60980 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:08.746791 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-90f2d4e7-7e32-44e1-a7a1-04c8fab60980 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1405 microversion: 2.20 time: 0.157726 May 25 16:21:08.747360 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 48/100] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:21:08 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:21:09.212656 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-3a0e7acf-dd79-40d9-9690-697dc8b19d51 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:09.213250 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-3a0e7acf-dd79-40d9-9690-697dc8b19d51 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:09.222855 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3a0e7acf-dd79-40d9-9690-697dc8b19d51 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:09.223655 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3a0e7acf-dd79-40d9-9690-697dc8b19d51 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:09.224565 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3a0e7acf-dd79-40d9-9690-697dc8b19d51 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:09.224991 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3a0e7acf-dd79-40d9-9690-697dc8b19d51 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:09.356936 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-3a0e7acf-dd79-40d9-9690-697dc8b19d51 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:09.365140 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-3a0e7acf-dd79-40d9-9690-697dc8b19d51 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98" status: 200 len: 1368 microversion: 2.1 time: 0.156495 May 25 16:21:09.365733 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 49/101] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:09 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:21:09.370872 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-996e68fa-64e1-4e3a-a1a3-8067e9e6eab0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:09.371476 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-996e68fa-64e1-4e3a-a1a3-8067e9e6eab0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:09.377167 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-996e68fa-64e1-4e3a-a1a3-8067e9e6eab0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:09.377614 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-996e68fa-64e1-4e3a-a1a3-8067e9e6eab0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:09.378432 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-996e68fa-64e1-4e3a-a1a3-8067e9e6eab0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:09.378870 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-996e68fa-64e1-4e3a-a1a3-8067e9e6eab0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:09.514888 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-996e68fa-64e1-4e3a-a1a3-8067e9e6eab0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:09.522475 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-996e68fa-64e1-4e3a-a1a3-8067e9e6eab0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1363 microversion: 2.1 time: 0.155787 May 25 16:21:09.523211 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 50/102] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:09 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:09.604133 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-84462744-6017-4806-ae6f-d9c2c988d543 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:09.604748 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-84462744-6017-4806-ae6f-d9c2c988d543 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:09.610682 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-84462744-6017-4806-ae6f-d9c2c988d543 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:09.611139 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-84462744-6017-4806-ae6f-d9c2c988d543 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:09.611906 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-84462744-6017-4806-ae6f-d9c2c988d543 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:09.612349 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-84462744-6017-4806-ae6f-d9c2c988d543 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:09.794892 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-84462744-6017-4806-ae6f-d9c2c988d543 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:09.802669 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-84462744-6017-4806-ae6f-d9c2c988d543 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1321 microversion: 2.1 time: 0.203205 May 25 16:21:09.803255 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 51/103] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:09 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:21:09.817019 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-932e35f0-85a4-4406-8a17-334175615f58 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:09.817848 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-932e35f0-85a4-4406-8a17-334175615f58 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:09.824359 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-932e35f0-85a4-4406-8a17-334175615f58 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:09.824801 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-932e35f0-85a4-4406-8a17-334175615f58 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:09.825843 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-932e35f0-85a4-4406-8a17-334175615f58 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:09.826433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-932e35f0-85a4-4406-8a17-334175615f58 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:09.849163 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=100 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:21:09.924155 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-09400d00-a14b-45c8-978b-4a5f8e787aa5 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "POST /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.280522 May 25 16:21:09.925907 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 53/104] 10.222.0.42 () {60 vars in 1322 bytes} [Wed May 25 16:21:07 2022] POST /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727/os-volume_attachments => generated 194 bytes in 2283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:21:10.023270 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-932e35f0-85a4-4406-8a17-334175615f58 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:10.035087 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-932e35f0-85a4-4406-8a17-334175615f58 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:10.040005 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-932e35f0-85a4-4406-8a17-334175615f58 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:10.041631 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-932e35f0-85a4-4406-8a17-334175615f58 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1405 microversion: 2.20 time: 0.235453 May 25 16:21:10.042393 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 52/105] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:21:09 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1405 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:21:10.267069 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-2d0641eb-b213-4e2b-bdb4-5e385b9226f8 req-fb4c3de1-14f3-473e-a4c7-702d3fc602d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cebf1f03-8c0a-4aaf-b375-63edcdac9d98", "name": "network-vif-plugged", "status": "completed", "tag": "a5479e6d-c810-409e-9dcb-42725ffdaeea"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:21:10.301009 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-2d0641eb-b213-4e2b-bdb4-5e385b9226f8 req-fb4c3de1-14f3-473e-a4c7-702d3fc602d7 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:10.302490 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-2d0641eb-b213-4e2b-bdb4-5e385b9226f8 req-fb4c3de1-14f3-473e-a4c7-702d3fc602d7 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:10.333255 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-2d0641eb-b213-4e2b-bdb4-5e385b9226f8 req-fb4c3de1-14f3-473e-a4c7-702d3fc602d7 service nova] Creating event network-vif-plugged:a5479e6d-c810-409e-9dcb-42725ffdaeea for instance cebf1f03-8c0a-4aaf-b375-63edcdac9d98 on hv-cinder-84327 May 25 16:21:10.343660 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-2d0641eb-b213-4e2b-bdb4-5e385b9226f8 req-fb4c3de1-14f3-473e-a4c7-702d3fc602d7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081488 May 25 16:21:10.346352 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 54/106] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:21:10.382641 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-2c3c97d1-2054-4f91-b12b-b433e51beec4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:10.383967 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-2c3c97d1-2054-4f91-b12b-b433e51beec4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:10.390656 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2c3c97d1-2054-4f91-b12b-b433e51beec4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:10.391368 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2c3c97d1-2054-4f91-b12b-b433e51beec4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:10.392288 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2c3c97d1-2054-4f91-b12b-b433e51beec4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:10.392872 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2c3c97d1-2054-4f91-b12b-b433e51beec4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:10.541478 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-1eb5b55b-2a83-41b2-a2f3-81d1c99281e6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:10.543098 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-1eb5b55b-2a83-41b2-a2f3-81d1c99281e6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:10.551312 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1eb5b55b-2a83-41b2-a2f3-81d1c99281e6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:10.552286 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1eb5b55b-2a83-41b2-a2f3-81d1c99281e6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:10.554035 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1eb5b55b-2a83-41b2-a2f3-81d1c99281e6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:10.554700 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1eb5b55b-2a83-41b2-a2f3-81d1c99281e6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:10.655776 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-2c3c97d1-2054-4f91-b12b-b433e51beec4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:10.667861 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-2c3c97d1-2054-4f91-b12b-b433e51beec4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98" status: 200 len: 1368 microversion: 2.1 time: 0.288923 May 25 16:21:10.671365 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 53/107] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:10 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 => generated 1368 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:10.775998 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-1eb5b55b-2a83-41b2-a2f3-81d1c99281e6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:10.794149 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-1eb5b55b-2a83-41b2-a2f3-81d1c99281e6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1363 microversion: 2.1 time: 0.257496 May 25 16:21:10.795076 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 55/108] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:10 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:10.819696 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-1977c377-0883-4c37-9c6c-1436ebbfbeee tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:10.820308 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-1977c377-0883-4c37-9c6c-1436ebbfbeee tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:10.828176 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1977c377-0883-4c37-9c6c-1436ebbfbeee tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:10.828818 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1977c377-0883-4c37-9c6c-1436ebbfbeee tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:10.830089 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1977c377-0883-4c37-9c6c-1436ebbfbeee tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:10.830089 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1977c377-0883-4c37-9c6c-1436ebbfbeee tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:11.017138 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-1977c377-0883-4c37-9c6c-1436ebbfbeee tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:11.025302 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-1977c377-0883-4c37-9c6c-1436ebbfbeee tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1321 microversion: 2.1 time: 0.209346 May 25 16:21:11.026093 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 54/109] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:10 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:11.062759 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-d4881e42-03a5-42a6-808d-184a321203a7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:11.063544 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-d4881e42-03a5-42a6-808d-184a321203a7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:11.071128 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d4881e42-03a5-42a6-808d-184a321203a7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:11.072239 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d4881e42-03a5-42a6-808d-184a321203a7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:11.073881 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d4881e42-03a5-42a6-808d-184a321203a7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:11.075377 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d4881e42-03a5-42a6-808d-184a321203a7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:11.278429 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-d4881e42-03a5-42a6-808d-184a321203a7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:11.286965 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-d4881e42-03a5-42a6-808d-184a321203a7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:11.288873 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-d4881e42-03a5-42a6-808d-184a321203a7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:11.290864 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-d4881e42-03a5-42a6-808d-184a321203a7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1405 microversion: 2.20 time: 0.232079 May 25 16:21:11.292071 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 56/110] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:21:11 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1405 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:21:11.684986 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-80d9a75a-1638-446a-bd4a-f00d6436058c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:11.685605 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-80d9a75a-1638-446a-bd4a-f00d6436058c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:11.691735 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-80d9a75a-1638-446a-bd4a-f00d6436058c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:11.692184 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-80d9a75a-1638-446a-bd4a-f00d6436058c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:11.693149 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-80d9a75a-1638-446a-bd4a-f00d6436058c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:11.693589 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-80d9a75a-1638-446a-bd4a-f00d6436058c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:11.811671 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-434c68de-d991-4a75-a791-efebbba5f7d5 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:11.812251 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-434c68de-d991-4a75-a791-efebbba5f7d5 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:11.818515 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-434c68de-d991-4a75-a791-efebbba5f7d5 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:11.818972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-434c68de-d991-4a75-a791-efebbba5f7d5 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:11.819748 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-434c68de-d991-4a75-a791-efebbba5f7d5 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:11.820186 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-434c68de-d991-4a75-a791-efebbba5f7d5 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:11.919974 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-80d9a75a-1638-446a-bd4a-f00d6436058c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:11.931025 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-80d9a75a-1638-446a-bd4a-f00d6436058c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98" status: 200 len: 1368 microversion: 2.1 time: 0.249503 May 25 16:21:11.941797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 55/111] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:11 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 => generated 1368 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:21:12.043305 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-7be3250d-8e9a-496d-bff1-88ed9a032335 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:12.044279 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-7be3250d-8e9a-496d-bff1-88ed9a032335 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:12.051108 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7be3250d-8e9a-496d-bff1-88ed9a032335 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:12.051566 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7be3250d-8e9a-496d-bff1-88ed9a032335 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:12.052415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7be3250d-8e9a-496d-bff1-88ed9a032335 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:12.053105 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7be3250d-8e9a-496d-bff1-88ed9a032335 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:12.300028 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-434c68de-d991-4a75-a791-efebbba5f7d5 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:12.310469 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-434c68de-d991-4a75-a791-efebbba5f7d5 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1363 microversion: 2.1 time: 0.502492 May 25 16:21:12.313285 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 57/112] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:11 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1363 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:21:12.317932 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-5a3834bb-43ae-4e73-8c76-8e2b1f2f037d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:12.324684 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-5a3834bb-43ae-4e73-8c76-8e2b1f2f037d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:12.337393 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5a3834bb-43ae-4e73-8c76-8e2b1f2f037d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:12.339894 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5a3834bb-43ae-4e73-8c76-8e2b1f2f037d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:12.341756 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5a3834bb-43ae-4e73-8c76-8e2b1f2f037d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:12.345111 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5a3834bb-43ae-4e73-8c76-8e2b1f2f037d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:12.380319 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-7be3250d-8e9a-496d-bff1-88ed9a032335 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:12.389986 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-7be3250d-8e9a-496d-bff1-88ed9a032335 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1321 microversion: 2.1 time: 0.351210 May 25 16:21:12.395720 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 56/113] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:12 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1321 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:21:12.594138 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-5a3834bb-43ae-4e73-8c76-8e2b1f2f037d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:12.603980 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-5a3834bb-43ae-4e73-8c76-8e2b1f2f037d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:12.605514 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-5a3834bb-43ae-4e73-8c76-8e2b1f2f037d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:12.606658 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-5a3834bb-43ae-4e73-8c76-8e2b1f2f037d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1405 microversion: 2.20 time: 0.292530 May 25 16:21:12.610725 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 58/114] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:21:12 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1405 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:21:12.951089 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-13cfe676-c4d3-4ed5-930c-e5842983f393 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:12.952510 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-13cfe676-c4d3-4ed5-930c-e5842983f393 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:12.961055 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-13cfe676-c4d3-4ed5-930c-e5842983f393 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:12.962081 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-13cfe676-c4d3-4ed5-930c-e5842983f393 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:12.963214 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-13cfe676-c4d3-4ed5-930c-e5842983f393 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:12.963728 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-13cfe676-c4d3-4ed5-930c-e5842983f393 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:13.116243 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-13cfe676-c4d3-4ed5-930c-e5842983f393 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:13.125931 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-13cfe676-c4d3-4ed5-930c-e5842983f393 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98" status: 200 len: 1368 microversion: 2.1 time: 0.178613 May 25 16:21:13.126788 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 57/115] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:12 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:13.330873 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-2030a288-4f3f-4c0d-bc38-1880e2f7a81e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:13.331574 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-2030a288-4f3f-4c0d-bc38-1880e2f7a81e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:13.339332 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2030a288-4f3f-4c0d-bc38-1880e2f7a81e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:13.348233 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2030a288-4f3f-4c0d-bc38-1880e2f7a81e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:13.348233 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2030a288-4f3f-4c0d-bc38-1880e2f7a81e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:13.348233 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2030a288-4f3f-4c0d-bc38-1880e2f7a81e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:13.412967 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-ed8f3808-f049-41a7-bae5-93c4e5577b2b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:13.415036 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-ed8f3808-f049-41a7-bae5-93c4e5577b2b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:13.421090 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:21:13.422865 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ed8f3808-f049-41a7-bae5-93c4e5577b2b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:13.423658 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ed8f3808-f049-41a7-bae5-93c4e5577b2b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:13.424504 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ed8f3808-f049-41a7-bae5-93c4e5577b2b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:13.425011 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ed8f3808-f049-41a7-bae5-93c4e5577b2b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:13.630577 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-2030a288-4f3f-4c0d-bc38-1880e2f7a81e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:13.654149 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-2030a288-4f3f-4c0d-bc38-1880e2f7a81e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1363 microversion: 2.1 time: 0.328279 May 25 16:21:13.654738 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 59/116] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:13 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1363 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:13.661883 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-a4663950-d75d-4e35-acac-f2c9a3c33e9b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:13.662525 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-a4663950-d75d-4e35-acac-f2c9a3c33e9b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:13.667772 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-ed8f3808-f049-41a7-bae5-93c4e5577b2b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:13.671548 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a4663950-d75d-4e35-acac-f2c9a3c33e9b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:13.672563 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a4663950-d75d-4e35-acac-f2c9a3c33e9b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:13.673679 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a4663950-d75d-4e35-acac-f2c9a3c33e9b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:13.674252 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a4663950-d75d-4e35-acac-f2c9a3c33e9b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:13.676048 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-ed8f3808-f049-41a7-bae5-93c4e5577b2b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1321 microversion: 2.1 time: 0.267476 May 25 16:21:13.677010 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 58/117] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:13 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:21:13.831070 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-a4663950-d75d-4e35-acac-f2c9a3c33e9b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:13.839992 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-a4663950-d75d-4e35-acac-f2c9a3c33e9b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:13.841485 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-a4663950-d75d-4e35-acac-f2c9a3c33e9b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:13.842608 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-a4663950-d75d-4e35-acac-f2c9a3c33e9b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1405 microversion: 2.20 time: 0.186954 May 25 16:21:13.843162 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 60/118] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:21:13 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1405 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:21:14.143308 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-85464afc-7f2a-4a68-af77-8351dff0e599 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:14.144484 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-85464afc-7f2a-4a68-af77-8351dff0e599 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:14.151051 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-85464afc-7f2a-4a68-af77-8351dff0e599 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:14.151501 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-85464afc-7f2a-4a68-af77-8351dff0e599 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:14.152284 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-85464afc-7f2a-4a68-af77-8351dff0e599 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:14.152716 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-85464afc-7f2a-4a68-af77-8351dff0e599 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:14.298735 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-85464afc-7f2a-4a68-af77-8351dff0e599 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:14.307357 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-85464afc-7f2a-4a68-af77-8351dff0e599 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98" status: 200 len: 1368 microversion: 2.1 time: 0.168139 May 25 16:21:14.307934 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 59/119] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:14 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:14.671085 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-94c10f37-9db5-49ae-beef-7c0013dc33d8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:14.671831 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-94c10f37-9db5-49ae-beef-7c0013dc33d8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:14.680551 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-94c10f37-9db5-49ae-beef-7c0013dc33d8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:14.681096 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-94c10f37-9db5-49ae-beef-7c0013dc33d8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:14.682306 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-94c10f37-9db5-49ae-beef-7c0013dc33d8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:14.683053 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-94c10f37-9db5-49ae-beef-7c0013dc33d8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:14.693264 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-03de21f7-c8ac-4ec0-9997-c35317456a3f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:14.694184 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-03de21f7-c8ac-4ec0-9997-c35317456a3f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:14.701544 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-03de21f7-c8ac-4ec0-9997-c35317456a3f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:14.702248 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-03de21f7-c8ac-4ec0-9997-c35317456a3f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:14.703294 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-03de21f7-c8ac-4ec0-9997-c35317456a3f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:14.703945 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-03de21f7-c8ac-4ec0-9997-c35317456a3f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:14.897477 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-94c10f37-9db5-49ae-beef-7c0013dc33d8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:14.903626 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-03de21f7-c8ac-4ec0-9997-c35317456a3f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:14.912509 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-03de21f7-c8ac-4ec0-9997-c35317456a3f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1321 microversion: 2.1 time: 0.222740 May 25 16:21:14.913824 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 60/120] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:14 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:21:14.930778 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-94c10f37-9db5-49ae-beef-7c0013dc33d8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1363 microversion: 2.1 time: 0.246436 May 25 16:21:14.930778 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 61/121] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:14 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:14.935257 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-28043572-b9e3-46e6-946e-4590ee38fb18 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:14.936845 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-28043572-b9e3-46e6-946e-4590ee38fb18 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:14.945742 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-28043572-b9e3-46e6-946e-4590ee38fb18 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:14.946490 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-28043572-b9e3-46e6-946e-4590ee38fb18 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:14.947812 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-28043572-b9e3-46e6-946e-4590ee38fb18 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:14.948286 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-28043572-b9e3-46e6-946e-4590ee38fb18 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:15.092051 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-28043572-b9e3-46e6-946e-4590ee38fb18 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:15.106608 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-28043572-b9e3-46e6-946e-4590ee38fb18 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:15.108592 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-28043572-b9e3-46e6-946e-4590ee38fb18 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:15.109827 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-28043572-b9e3-46e6-946e-4590ee38fb18 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1405 microversion: 2.20 time: 0.192055 May 25 16:21:15.110606 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 62/122] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:21:14 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:21:15.324059 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-4e2761dc-97d4-487c-a2c3-078c88854a94 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:15.325319 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-4e2761dc-97d4-487c-a2c3-078c88854a94 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:15.332739 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4e2761dc-97d4-487c-a2c3-078c88854a94 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:15.333418 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4e2761dc-97d4-487c-a2c3-078c88854a94 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:15.334396 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4e2761dc-97d4-487c-a2c3-078c88854a94 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:15.335071 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4e2761dc-97d4-487c-a2c3-078c88854a94 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:15.496674 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-4e2761dc-97d4-487c-a2c3-078c88854a94 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:15.504649 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-4e2761dc-97d4-487c-a2c3-078c88854a94 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98" status: 200 len: 1368 microversion: 2.1 time: 0.184889 May 25 16:21:15.515698 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 61/123] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:15 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:15.932601 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-ab86f61a-cec0-411f-baf4-1f0cf1e4fad0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:15.933535 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-ab86f61a-cec0-411f-baf4-1f0cf1e4fad0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:15.941284 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ab86f61a-cec0-411f-baf4-1f0cf1e4fad0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:15.941887 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ab86f61a-cec0-411f-baf4-1f0cf1e4fad0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:15.942737 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ab86f61a-cec0-411f-baf4-1f0cf1e4fad0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:15.943244 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ab86f61a-cec0-411f-baf4-1f0cf1e4fad0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:15.943437 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-6a0841ef-7654-4d97-aeb4-204a10f31caf tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:15.944343 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-6a0841ef-7654-4d97-aeb4-204a10f31caf tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:15.953770 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6a0841ef-7654-4d97-aeb4-204a10f31caf tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:15.954615 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6a0841ef-7654-4d97-aeb4-204a10f31caf tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:15.956054 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6a0841ef-7654-4d97-aeb4-204a10f31caf tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:15.956985 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6a0841ef-7654-4d97-aeb4-204a10f31caf tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:16.130141 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-ab86f61a-cec0-411f-baf4-1f0cf1e4fad0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:16.140215 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-ab86f61a-cec0-411f-baf4-1f0cf1e4fad0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1363 microversion: 2.1 time: 0.211629 May 25 16:21:16.142386 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 63/124] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:15 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:16.154979 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-e1c8b4c9-3242-4cc8-93bb-534918ded149 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:16.155604 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-e1c8b4c9-3242-4cc8-93bb-534918ded149 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:16.162530 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e1c8b4c9-3242-4cc8-93bb-534918ded149 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:16.163467 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e1c8b4c9-3242-4cc8-93bb-534918ded149 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:16.164527 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e1c8b4c9-3242-4cc8-93bb-534918ded149 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:16.165190 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e1c8b4c9-3242-4cc8-93bb-534918ded149 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:16.196627 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:21:16.241370 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-6a0841ef-7654-4d97-aeb4-204a10f31caf tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:16.253988 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-6a0841ef-7654-4d97-aeb4-204a10f31caf tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1321 microversion: 2.1 time: 0.316994 May 25 16:21:16.254938 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 62/125] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:15 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1321 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:21:16.344272 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-e1c8b4c9-3242-4cc8-93bb-534918ded149 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:16.359225 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-e1c8b4c9-3242-4cc8-93bb-534918ded149 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:16.360973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-e1c8b4c9-3242-4cc8-93bb-534918ded149 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:16.362360 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-e1c8b4c9-3242-4cc8-93bb-534918ded149 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1405 microversion: 2.20 time: 0.217603 May 25 16:21:16.363069 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 64/126] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:21:16 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1405 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:21:16.523848 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-5ab629e3-47ce-4df5-97c9-1c1132ac0b9d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:16.524587 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-5ab629e3-47ce-4df5-97c9-1c1132ac0b9d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:16.535000 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5ab629e3-47ce-4df5-97c9-1c1132ac0b9d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:16.535602 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5ab629e3-47ce-4df5-97c9-1c1132ac0b9d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:16.536879 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5ab629e3-47ce-4df5-97c9-1c1132ac0b9d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:16.537326 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5ab629e3-47ce-4df5-97c9-1c1132ac0b9d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:16.745474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-5ab629e3-47ce-4df5-97c9-1c1132ac0b9d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:16.767631 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-5ab629e3-47ce-4df5-97c9-1c1132ac0b9d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98" status: 200 len: 1368 microversion: 2.1 time: 0.244190 May 25 16:21:16.768344 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 63/127] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:16 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 => generated 1368 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:17.159535 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-9c604b4e-489a-446b-bbed-495c4d3de6ea tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:17.160808 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-9c604b4e-489a-446b-bbed-495c4d3de6ea tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:17.168493 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9c604b4e-489a-446b-bbed-495c4d3de6ea tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:17.168940 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9c604b4e-489a-446b-bbed-495c4d3de6ea tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:17.169707 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9c604b4e-489a-446b-bbed-495c4d3de6ea tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:17.171202 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9c604b4e-489a-446b-bbed-495c4d3de6ea tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:17.271514 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-af625b43-1325-4d34-ad36-3a2a4debd322 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:17.272481 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-af625b43-1325-4d34-ad36-3a2a4debd322 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:17.279179 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-af625b43-1325-4d34-ad36-3a2a4debd322 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:17.279956 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-af625b43-1325-4d34-ad36-3a2a4debd322 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:17.281040 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-af625b43-1325-4d34-ad36-3a2a4debd322 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:17.281902 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-af625b43-1325-4d34-ad36-3a2a4debd322 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:17.383575 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-9c604b4e-489a-446b-bbed-495c4d3de6ea tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:17.392744 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-9c604b4e-489a-446b-bbed-495c4d3de6ea tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1363 microversion: 2.1 time: 0.237834 May 25 16:21:17.393489 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 65/128] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:17 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:17.402926 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-171cbfb8-c053-459c-8b9d-0e5084eb1ee1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:17.403531 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-171cbfb8-c053-459c-8b9d-0e5084eb1ee1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:17.409623 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-171cbfb8-c053-459c-8b9d-0e5084eb1ee1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:17.410127 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-171cbfb8-c053-459c-8b9d-0e5084eb1ee1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:17.411081 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-171cbfb8-c053-459c-8b9d-0e5084eb1ee1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:17.411524 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-171cbfb8-c053-459c-8b9d-0e5084eb1ee1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:17.456571 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-af625b43-1325-4d34-ad36-3a2a4debd322 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:17.467046 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-af625b43-1325-4d34-ad36-3a2a4debd322 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1321 microversion: 2.1 time: 0.200460 May 25 16:21:17.467640 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 64/129] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:17 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:17.570380 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-171cbfb8-c053-459c-8b9d-0e5084eb1ee1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:17.579323 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-171cbfb8-c053-459c-8b9d-0e5084eb1ee1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:17.580828 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-171cbfb8-c053-459c-8b9d-0e5084eb1ee1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:17.581974 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-171cbfb8-c053-459c-8b9d-0e5084eb1ee1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1405 microversion: 2.20 time: 0.187148 May 25 16:21:17.582525 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 66/130] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:21:17 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1405 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:21:17.786069 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-eb28568a-d794-4170-9520-ecb0cbb808aa tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:17.786924 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-eb28568a-d794-4170-9520-ecb0cbb808aa tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:17.793864 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-eb28568a-d794-4170-9520-ecb0cbb808aa tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:17.794313 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-eb28568a-d794-4170-9520-ecb0cbb808aa tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:17.795065 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-eb28568a-d794-4170-9520-ecb0cbb808aa tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:17.795493 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-eb28568a-d794-4170-9520-ecb0cbb808aa tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:17.984765 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-eb28568a-d794-4170-9520-ecb0cbb808aa tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:17.995033 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-eb28568a-d794-4170-9520-ecb0cbb808aa tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98" status: 200 len: 1558 microversion: 2.1 time: 0.213264 May 25 16:21:18.007314 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 65/131] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:17 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:18.013939 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-7d58fcaa-c5a6-42ea-95c3-8319f3dce6e5 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:18.014780 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-7d58fcaa-c5a6-42ea-95c3-8319f3dce6e5 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:18.023308 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7d58fcaa-c5a6-42ea-95c3-8319f3dce6e5 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:18.024274 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7d58fcaa-c5a6-42ea-95c3-8319f3dce6e5 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:18.025174 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7d58fcaa-c5a6-42ea-95c3-8319f3dce6e5 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:18.025906 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7d58fcaa-c5a6-42ea-95c3-8319f3dce6e5 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:18.116434 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-7d58fcaa-c5a6-42ea-95c3-8319f3dce6e5 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106632 May 25 16:21:18.121880 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 67/132] 10.222.0.42 () {58 vars in 1274 bytes} [Wed May 25 16:21:18 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:21:18.339830 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-0a6516c5-58e5-40fe-a66a-f89b713f9a41 req-8fd3cc20-4b57-445f-b78c-838955dedabc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f324c4-3a3e-4e8d-b2ca-91493fae47b1", "name": "network-vif-plugged", "status": "completed", "tag": "b95684f0-92c8-457d-bd07-c98d017be6fc"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:21:18.355837 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-0a6516c5-58e5-40fe-a66a-f89b713f9a41 req-8fd3cc20-4b57-445f-b78c-838955dedabc service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:18.357256 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-0a6516c5-58e5-40fe-a66a-f89b713f9a41 req-8fd3cc20-4b57-445f-b78c-838955dedabc service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:18.370483 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-0a6516c5-58e5-40fe-a66a-f89b713f9a41 req-8fd3cc20-4b57-445f-b78c-838955dedabc service nova] Creating event network-vif-plugged:b95684f0-92c8-457d-bd07-c98d017be6fc for instance 68f324c4-3a3e-4e8d-b2ca-91493fae47b1 on hv-cinder-84327 May 25 16:21:18.377911 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-0a6516c5-58e5-40fe-a66a-f89b713f9a41 req-8fd3cc20-4b57-445f-b78c-838955dedabc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042923 May 25 16:21:18.378968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 66/133] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:21:18.416080 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-046e69ea-f3d1-4fc7-8fa6-0f13ad7b627a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:18.418045 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-046e69ea-f3d1-4fc7-8fa6-0f13ad7b627a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:18.434205 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-046e69ea-f3d1-4fc7-8fa6-0f13ad7b627a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:18.435790 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-046e69ea-f3d1-4fc7-8fa6-0f13ad7b627a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:18.437002 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-046e69ea-f3d1-4fc7-8fa6-0f13ad7b627a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:18.437855 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-046e69ea-f3d1-4fc7-8fa6-0f13ad7b627a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:18.493309 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-67bcfa2c-68eb-4e7a-a324-abd2218ce022 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:18.495130 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-67bcfa2c-68eb-4e7a-a324-abd2218ce022 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:18.516233 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-67bcfa2c-68eb-4e7a-a324-abd2218ce022 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:18.518135 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-67bcfa2c-68eb-4e7a-a324-abd2218ce022 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:18.519512 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-67bcfa2c-68eb-4e7a-a324-abd2218ce022 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:18.520197 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-67bcfa2c-68eb-4e7a-a324-abd2218ce022 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:18.979403 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-046e69ea-f3d1-4fc7-8fa6-0f13ad7b627a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:18.988045 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-046e69ea-f3d1-4fc7-8fa6-0f13ad7b627a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1363 microversion: 2.1 time: 0.580615 May 25 16:21:18.989031 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 68/134] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:18 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1363 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:18.992767 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-67bcfa2c-68eb-4e7a-a324-abd2218ce022 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:18.995224 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-db4509b6-5df9-458e-a5a8-4265cd502cfa tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:18.995822 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-db4509b6-5df9-458e-a5a8-4265cd502cfa tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:19.001883 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-db4509b6-5df9-458e-a5a8-4265cd502cfa tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:19.002331 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-db4509b6-5df9-458e-a5a8-4265cd502cfa tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:19.003089 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-db4509b6-5df9-458e-a5a8-4265cd502cfa tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:19.003537 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-db4509b6-5df9-458e-a5a8-4265cd502cfa tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:19.004405 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-67bcfa2c-68eb-4e7a-a324-abd2218ce022 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1321 microversion: 2.1 time: 0.524084 May 25 16:21:19.014894 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 67/135] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:18 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1321 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:19.206074 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-db4509b6-5df9-458e-a5a8-4265cd502cfa tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:19.218064 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-db4509b6-5df9-458e-a5a8-4265cd502cfa tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:19.221260 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-db4509b6-5df9-458e-a5a8-4265cd502cfa tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:19.222785 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-db4509b6-5df9-458e-a5a8-4265cd502cfa tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1405 microversion: 2.20 time: 0.232594 May 25 16:21:19.223923 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 69/136] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:21:18 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1405 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:21:19.729607 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-22a55fbc-3ae2-40ea-bca3-3c35353d6689 req-618811f0-96c8-4f2b-9532-3264e546d1ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cebf1f03-8c0a-4aaf-b375-63edcdac9d98", "tag": "a5479e6d-c810-409e-9dcb-42725ffdaeea"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:21:19.738291 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-22a55fbc-3ae2-40ea-bca3-3c35353d6689 req-618811f0-96c8-4f2b-9532-3264e546d1ad service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:19.739187 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-22a55fbc-3ae2-40ea-bca3-3c35353d6689 req-618811f0-96c8-4f2b-9532-3264e546d1ad service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:19.753539 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-22a55fbc-3ae2-40ea-bca3-3c35353d6689 req-618811f0-96c8-4f2b-9532-3264e546d1ad service nova] Creating event network-changed:a5479e6d-c810-409e-9dcb-42725ffdaeea for instance cebf1f03-8c0a-4aaf-b375-63edcdac9d98 on hv-cinder-84327 May 25 16:21:19.759398 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-22a55fbc-3ae2-40ea-bca3-3c35353d6689 req-618811f0-96c8-4f2b-9532-3264e546d1ad service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033312 May 25 16:21:19.760025 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 68/137] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:21:20.005908 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-10a657d6-1265-4b84-bf91-01b73e13e0cf tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:20.006566 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-10a657d6-1265-4b84-bf91-01b73e13e0cf tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:20.013810 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-10a657d6-1265-4b84-bf91-01b73e13e0cf tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:20.014263 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-10a657d6-1265-4b84-bf91-01b73e13e0cf tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:20.015035 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-10a657d6-1265-4b84-bf91-01b73e13e0cf tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:20.015481 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-10a657d6-1265-4b84-bf91-01b73e13e0cf tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:20.021623 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-030372d7-a639-4c28-8e73-ba7bfebc8459 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:20.023207 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-030372d7-a639-4c28-8e73-ba7bfebc8459 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:20.030116 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-030372d7-a639-4c28-8e73-ba7bfebc8459 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:20.030575 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-030372d7-a639-4c28-8e73-ba7bfebc8459 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:20.031801 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-030372d7-a639-4c28-8e73-ba7bfebc8459 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:20.031801 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-030372d7-a639-4c28-8e73-ba7bfebc8459 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:20.223870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-10a657d6-1265-4b84-bf91-01b73e13e0cf tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:20.232623 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-10a657d6-1265-4b84-bf91-01b73e13e0cf tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1363 microversion: 2.1 time: 0.230675 May 25 16:21:20.233399 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 70/138] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:20 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:20.234379 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-030372d7-a639-4c28-8e73-ba7bfebc8459 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:20.242365 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-030372d7-a639-4c28-8e73-ba7bfebc8459 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1321 microversion: 2.1 time: 0.224591 May 25 16:21:20.242588 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-03ee70e0-5b82-417f-bcd4-dfa855bf0a22 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:20.243194 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-03ee70e0-5b82-417f-bcd4-dfa855bf0a22 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:20.249610 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-03ee70e0-5b82-417f-bcd4-dfa855bf0a22 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:20.250112 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-03ee70e0-5b82-417f-bcd4-dfa855bf0a22 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:20.251041 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-03ee70e0-5b82-417f-bcd4-dfa855bf0a22 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:20.251481 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-03ee70e0-5b82-417f-bcd4-dfa855bf0a22 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:20.253053 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 69/139] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:20 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:21:20.380933 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-03ee70e0-5b82-417f-bcd4-dfa855bf0a22 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:20.390352 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-03ee70e0-5b82-417f-bcd4-dfa855bf0a22 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:20.391860 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-03ee70e0-5b82-417f-bcd4-dfa855bf0a22 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:20.392977 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-03ee70e0-5b82-417f-bcd4-dfa855bf0a22 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1405 microversion: 2.20 time: 0.154745 May 25 16:21:20.393534 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 71/140] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:21:20 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:21:20.395421 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-0f61694f-488a-43db-9623-ba3e60809652 req-61fc530d-4fea-4f2c-bb33-be6bc516d14d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "756c834d-49bb-4cd7-b5c7-7140c66b0d0c", "name": "network-vif-plugged", "status": "completed", "tag": "32e483c1-8f09-4e2a-9e95-ef7a5e449743"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:21:20.403805 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-0f61694f-488a-43db-9623-ba3e60809652 req-61fc530d-4fea-4f2c-bb33-be6bc516d14d service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:20.404391 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-0f61694f-488a-43db-9623-ba3e60809652 req-61fc530d-4fea-4f2c-bb33-be6bc516d14d service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:20.416694 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-0f61694f-488a-43db-9623-ba3e60809652 req-61fc530d-4fea-4f2c-bb33-be6bc516d14d service nova] Creating event network-vif-plugged:32e483c1-8f09-4e2a-9e95-ef7a5e449743 for instance 756c834d-49bb-4cd7-b5c7-7140c66b0d0c on hv-cinder-84327 May 25 16:21:20.421448 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-0f61694f-488a-43db-9623-ba3e60809652 req-61fc530d-4fea-4f2c-bb33-be6bc516d14d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030342 May 25 16:21:20.422079 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 70/141] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:21:21.249611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-d64ff954-bbf4-494d-951c-55ef4172314a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:21.250241 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-d64ff954-bbf4-494d-951c-55ef4172314a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:21.256759 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d64ff954-bbf4-494d-951c-55ef4172314a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:21.257204 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d64ff954-bbf4-494d-951c-55ef4172314a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:21.258670 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d64ff954-bbf4-494d-951c-55ef4172314a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:21.259102 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d64ff954-bbf4-494d-951c-55ef4172314a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:21.260321 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-aeca6980-a4c4-42a2-afd5-11cc19dd7e38 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:21.261013 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-aeca6980-a4c4-42a2-afd5-11cc19dd7e38 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:21.267135 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-aeca6980-a4c4-42a2-afd5-11cc19dd7e38 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:21.267582 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-aeca6980-a4c4-42a2-afd5-11cc19dd7e38 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:21.268341 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-aeca6980-a4c4-42a2-afd5-11cc19dd7e38 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:21.268782 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-aeca6980-a4c4-42a2-afd5-11cc19dd7e38 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:21.271435 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=100 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:21:21.657180 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-d64ff954-bbf4-494d-951c-55ef4172314a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:21.660218 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-aeca6980-a4c4-42a2-afd5-11cc19dd7e38 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:21.667669 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-d64ff954-bbf4-494d-951c-55ef4172314a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1363 microversion: 2.1 time: 0.421786 May 25 16:21:21.668111 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-aeca6980-a4c4-42a2-afd5-11cc19dd7e38 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1321 microversion: 2.1 time: 0.412710 May 25 16:21:21.668551 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 72/142] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:21 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1363 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:21.668686 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 71/143] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:21 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1321 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:21:21.673410 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-81283bbf-4fc2-4b5d-9daa-22fa9d6cb41e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:21.674038 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-81283bbf-4fc2-4b5d-9daa-22fa9d6cb41e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:21.680673 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-81283bbf-4fc2-4b5d-9daa-22fa9d6cb41e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:21.681477 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-81283bbf-4fc2-4b5d-9daa-22fa9d6cb41e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:21.682338 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-81283bbf-4fc2-4b5d-9daa-22fa9d6cb41e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:21.682797 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-81283bbf-4fc2-4b5d-9daa-22fa9d6cb41e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:21.821104 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-81283bbf-4fc2-4b5d-9daa-22fa9d6cb41e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:21.829393 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-81283bbf-4fc2-4b5d-9daa-22fa9d6cb41e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:21.830974 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-81283bbf-4fc2-4b5d-9daa-22fa9d6cb41e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:21.832087 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-81283bbf-4fc2-4b5d-9daa-22fa9d6cb41e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1405 microversion: 2.20 time: 0.162235 May 25 16:21:21.832639 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 73/144] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:21:21 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:21:22.684847 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-05b8ede6-9e4b-4531-b120-84ca6fd59350 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:22.685440 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-56bb5911-38e7-4d69-99f2-2c631166587d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:22.685933 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-05b8ede6-9e4b-4531-b120-84ca6fd59350 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:22.686015 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-56bb5911-38e7-4d69-99f2-2c631166587d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:22.692091 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-05b8ede6-9e4b-4531-b120-84ca6fd59350 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:22.692267 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-56bb5911-38e7-4d69-99f2-2c631166587d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:22.692552 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-56bb5911-38e7-4d69-99f2-2c631166587d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:22.692941 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-05b8ede6-9e4b-4531-b120-84ca6fd59350 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:22.693359 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-56bb5911-38e7-4d69-99f2-2c631166587d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:22.693828 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-56bb5911-38e7-4d69-99f2-2c631166587d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:22.694077 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-05b8ede6-9e4b-4531-b120-84ca6fd59350 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:22.694712 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-05b8ede6-9e4b-4531-b120-84ca6fd59350 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:22.887141 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-05b8ede6-9e4b-4531-b120-84ca6fd59350 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:22.894647 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-05b8ede6-9e4b-4531-b120-84ca6fd59350 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1321 microversion: 2.1 time: 0.213561 May 25 16:21:22.895314 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 72/145] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:22 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:21:22.897462 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-56bb5911-38e7-4d69-99f2-2c631166587d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:22.902622 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-f396270b-18d5-4fc0-8e0b-410a58578047 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:22.903641 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-f396270b-18d5-4fc0-8e0b-410a58578047 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:22.908229 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-56bb5911-38e7-4d69-99f2-2c631166587d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1363 microversion: 2.1 time: 0.227089 May 25 16:21:22.908809 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 74/146] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:22 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:21:22.910615 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f396270b-18d5-4fc0-8e0b-410a58578047 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:22.911066 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f396270b-18d5-4fc0-8e0b-410a58578047 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:22.911836 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f396270b-18d5-4fc0-8e0b-410a58578047 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:22.912397 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f396270b-18d5-4fc0-8e0b-410a58578047 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:23.036524 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-f396270b-18d5-4fc0-8e0b-410a58578047 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:23.044666 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-f396270b-18d5-4fc0-8e0b-410a58578047 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:23.046205 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-f396270b-18d5-4fc0-8e0b-410a58578047 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:23.047301 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-f396270b-18d5-4fc0-8e0b-410a58578047 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1405 microversion: 2.20 time: 0.150377 May 25 16:21:23.047876 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 73/147] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:21:22 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:21:23.161930 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-d383ab83-375e-40c5-960f-8289c02e3ea0 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:23.162432 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-d383ab83-375e-40c5-960f-8289c02e3ea0 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:23.169146 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d383ab83-375e-40c5-960f-8289c02e3ea0 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:23.169592 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d383ab83-375e-40c5-960f-8289c02e3ea0 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:23.170393 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d383ab83-375e-40c5-960f-8289c02e3ea0 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:23.170828 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d383ab83-375e-40c5-960f-8289c02e3ea0 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:23.197391 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-d383ab83-375e-40c5-960f-8289c02e3ea0 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Going to try to terminate instance {{(pid=117510) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:21:23.302983 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-d383ab83-375e-40c5-960f-8289c02e3ea0 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 204 len: 0 microversion: 2.1 time: 0.144912 May 25 16:21:23.303588 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 75/148] 10.222.0.42 () {58 vars in 1238 bytes} [Wed May 25 16:21:23 2022] DELETE /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:21:23.311882 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-e93e4742-0991-4bf5-b7ec-1a60206f045e tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:23.312489 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-e93e4742-0991-4bf5-b7ec-1a60206f045e tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:23.319133 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e93e4742-0991-4bf5-b7ec-1a60206f045e tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:23.320581 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e93e4742-0991-4bf5-b7ec-1a60206f045e tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:23.321369 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e93e4742-0991-4bf5-b7ec-1a60206f045e tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:23.321803 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e93e4742-0991-4bf5-b7ec-1a60206f045e tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:23.484218 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-e93e4742-0991-4bf5-b7ec-1a60206f045e tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18cd966ad655466e85930f7c505fb360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5ee0d2e59647dc98721de1b8dfb4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:23.498801 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-e93e4742-0991-4bf5-b7ec-1a60206f045e tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 200 len: 1553 microversion: 2.1 time: 0.190563 May 25 16:21:23.510605 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 74/149] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:23 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 1553 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:23.826193 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-d511100d-402f-4e58-813b-e02e1a7bca82 req-e4ef74ed-95c3-42e3-adeb-80b51e4815f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3da72ce-f083-455e-ae40-9530c53126ef", "name": "network-vif-plugged", "status": "completed", "tag": "81d48be3-f76c-4118-bcaa-79360428da5a"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:21:23.842660 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-d511100d-402f-4e58-813b-e02e1a7bca82 req-e4ef74ed-95c3-42e3-adeb-80b51e4815f6 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:23.843874 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-d511100d-402f-4e58-813b-e02e1a7bca82 req-e4ef74ed-95c3-42e3-adeb-80b51e4815f6 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:23.862908 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-d511100d-402f-4e58-813b-e02e1a7bca82 req-e4ef74ed-95c3-42e3-adeb-80b51e4815f6 service nova] Creating event network-vif-plugged:81d48be3-f76c-4118-bcaa-79360428da5a for instance d3da72ce-f083-455e-ae40-9530c53126ef on hv-cinder-84327 May 25 16:21:23.868229 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-d511100d-402f-4e58-813b-e02e1a7bca82 req-e4ef74ed-95c3-42e3-adeb-80b51e4815f6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047763 May 25 16:21:23.868906 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 76/150] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:21:23.912265 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-fc60ce73-5455-4cbe-8ecb-f3127de79947 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:23.913239 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-fc60ce73-5455-4cbe-8ecb-f3127de79947 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:23.921609 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fc60ce73-5455-4cbe-8ecb-f3127de79947 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:23.922209 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fc60ce73-5455-4cbe-8ecb-f3127de79947 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:23.923246 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fc60ce73-5455-4cbe-8ecb-f3127de79947 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:23.924003 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fc60ce73-5455-4cbe-8ecb-f3127de79947 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:23.930701 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-8dc06c27-90d4-447b-90cb-1331fba6603c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:23.931960 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-8dc06c27-90d4-447b-90cb-1331fba6603c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:23.940341 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8dc06c27-90d4-447b-90cb-1331fba6603c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:23.941850 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8dc06c27-90d4-447b-90cb-1331fba6603c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:23.942624 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8dc06c27-90d4-447b-90cb-1331fba6603c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:23.943241 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8dc06c27-90d4-447b-90cb-1331fba6603c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:24.121412 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-fc60ce73-5455-4cbe-8ecb-f3127de79947 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:24.128847 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-fc60ce73-5455-4cbe-8ecb-f3127de79947 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1321 microversion: 2.1 time: 0.221076 May 25 16:21:24.129447 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 75/151] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:23 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:24.134897 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-57e9595a-ece0-4eb5-90da-4ae0b3bf54f4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:24.135497 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-57e9595a-ece0-4eb5-90da-4ae0b3bf54f4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:24.143233 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-57e9595a-ece0-4eb5-90da-4ae0b3bf54f4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:24.143679 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-57e9595a-ece0-4eb5-90da-4ae0b3bf54f4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:24.144445 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-57e9595a-ece0-4eb5-90da-4ae0b3bf54f4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:24.144970 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-57e9595a-ece0-4eb5-90da-4ae0b3bf54f4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:24.145690 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-8dc06c27-90d4-447b-90cb-1331fba6603c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:24.154481 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-8dc06c27-90d4-447b-90cb-1331fba6603c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1363 microversion: 2.1 time: 0.229730 May 25 16:21:24.155074 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 77/152] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:23 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:24.282480 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-57e9595a-ece0-4eb5-90da-4ae0b3bf54f4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:24.292005 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-57e9595a-ece0-4eb5-90da-4ae0b3bf54f4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:24.293980 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-57e9595a-ece0-4eb5-90da-4ae0b3bf54f4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:24.295148 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-57e9595a-ece0-4eb5-90da-4ae0b3bf54f4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1405 microversion: 2.20 time: 0.164750 May 25 16:21:24.295710 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 76/153] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:21:24 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:21:24.516346 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-199013d7-fe60-428e-b548-a54a8a2d83d8 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:24.516953 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-199013d7-fe60-428e-b548-a54a8a2d83d8 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:24.523022 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-199013d7-fe60-428e-b548-a54a8a2d83d8 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:24.524217 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-199013d7-fe60-428e-b548-a54a8a2d83d8 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:24.524985 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-199013d7-fe60-428e-b548-a54a8a2d83d8 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:24.525432 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-199013d7-fe60-428e-b548-a54a8a2d83d8 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:24.653916 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-199013d7-fe60-428e-b548-a54a8a2d83d8 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18cd966ad655466e85930f7c505fb360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5ee0d2e59647dc98721de1b8dfb4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:24.662041 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-199013d7-fe60-428e-b548-a54a8a2d83d8 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 200 len: 1553 microversion: 2.1 time: 0.149509 May 25 16:21:24.662858 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 78/154] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:24 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:25.145705 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-898f3f34-e242-4f6a-ae48-cfaf00d9d6f8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:25.146697 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-898f3f34-e242-4f6a-ae48-cfaf00d9d6f8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:25.153415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-898f3f34-e242-4f6a-ae48-cfaf00d9d6f8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:25.153956 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-898f3f34-e242-4f6a-ae48-cfaf00d9d6f8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:25.154950 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-898f3f34-e242-4f6a-ae48-cfaf00d9d6f8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:25.155469 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-898f3f34-e242-4f6a-ae48-cfaf00d9d6f8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:25.174390 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-0ab0a427-4007-4c5d-ade5-0a4540e8b2b7 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:25.175044 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-0ab0a427-4007-4c5d-ade5-0a4540e8b2b7 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:25.188113 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0ab0a427-4007-4c5d-ade5-0a4540e8b2b7 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:25.188908 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0ab0a427-4007-4c5d-ade5-0a4540e8b2b7 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:25.191016 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0ab0a427-4007-4c5d-ade5-0a4540e8b2b7 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:25.191689 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0ab0a427-4007-4c5d-ade5-0a4540e8b2b7 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:25.383241 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-898f3f34-e242-4f6a-ae48-cfaf00d9d6f8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:25.392687 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-898f3f34-e242-4f6a-ae48-cfaf00d9d6f8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1321 microversion: 2.1 time: 0.250650 May 25 16:21:25.402173 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 77/155] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:25 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:25.402173 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-61c39169-7294-4159-ab6b-cb6d8e2c9a38 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:25.402173 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-61c39169-7294-4159-ab6b-cb6d8e2c9a38 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:25.404996 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-61c39169-7294-4159-ab6b-cb6d8e2c9a38 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:25.405449 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-61c39169-7294-4159-ab6b-cb6d8e2c9a38 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:25.405864 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-0ab0a427-4007-4c5d-ade5-0a4540e8b2b7 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:25.406247 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-61c39169-7294-4159-ab6b-cb6d8e2c9a38 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:25.406686 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-61c39169-7294-4159-ab6b-cb6d8e2c9a38 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:25.414593 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-0ab0a427-4007-4c5d-ade5-0a4540e8b2b7 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1363 microversion: 2.1 time: 0.243969 May 25 16:21:25.415395 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 79/156] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:25 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:21:25.592623 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-61c39169-7294-4159-ab6b-cb6d8e2c9a38 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:25.604160 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-61c39169-7294-4159-ab6b-cb6d8e2c9a38 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:25.606970 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-61c39169-7294-4159-ab6b-cb6d8e2c9a38 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:25.608391 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-61c39169-7294-4159-ab6b-cb6d8e2c9a38 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1405 microversion: 2.20 time: 0.213661 May 25 16:21:25.623190 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 78/157] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:21:25 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1405 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:21:25.683099 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-e7de8424-0ea4-46e7-ad65-e869fbc126ae tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:25.683711 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-e7de8424-0ea4-46e7-ad65-e869fbc126ae tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:25.690958 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e7de8424-0ea4-46e7-ad65-e869fbc126ae tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:25.691639 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e7de8424-0ea4-46e7-ad65-e869fbc126ae tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:25.692995 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e7de8424-0ea4-46e7-ad65-e869fbc126ae tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:25.693664 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e7de8424-0ea4-46e7-ad65-e869fbc126ae tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:25.698969 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:21:25.892023 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-08ea76e9-1af5-4d42-bc19-4f2b29fda861 req-2e533c81-167d-4f22-87b8-382332de5e75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c525fad-3e59-4bcd-9263-cf3a13d13e3f", "name": "network-vif-plugged", "status": "completed", "tag": "5d7ffb26-b14c-4496-a249-7c6754e10040"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:21:25.901865 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-08ea76e9-1af5-4d42-bc19-4f2b29fda861 req-2e533c81-167d-4f22-87b8-382332de5e75 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:25.902419 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-08ea76e9-1af5-4d42-bc19-4f2b29fda861 req-2e533c81-167d-4f22-87b8-382332de5e75 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:25.920350 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-08ea76e9-1af5-4d42-bc19-4f2b29fda861 req-2e533c81-167d-4f22-87b8-382332de5e75 service nova] Creating event network-vif-plugged:5d7ffb26-b14c-4496-a249-7c6754e10040 for instance 9c525fad-3e59-4bcd-9263-cf3a13d13e3f on hv-cinder-84327 May 25 16:21:25.928184 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-08ea76e9-1af5-4d42-bc19-4f2b29fda861 req-2e533c81-167d-4f22-87b8-382332de5e75 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039169 May 25 16:21:25.931281 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 79/158] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:21:25.960967 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-e7de8424-0ea4-46e7-ad65-e869fbc126ae tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18cd966ad655466e85930f7c505fb360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5ee0d2e59647dc98721de1b8dfb4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:25.978951 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-e7de8424-0ea4-46e7-ad65-e869fbc126ae tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 200 len: 1553 microversion: 2.1 time: 0.300037 May 25 16:21:25.983735 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 80/159] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:25 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 1553 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:26.416059 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-4280063e-096d-4c5a-bce2-f70261a72544 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:26.417282 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-4280063e-096d-4c5a-bce2-f70261a72544 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:26.432214 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-5954c7c2-7739-4a88-bccf-69ff6ed8a995 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:26.433123 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-5954c7c2-7739-4a88-bccf-69ff6ed8a995 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:26.435787 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4280063e-096d-4c5a-bce2-f70261a72544 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:26.437163 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4280063e-096d-4c5a-bce2-f70261a72544 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:26.438558 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4280063e-096d-4c5a-bce2-f70261a72544 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:26.440677 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5954c7c2-7739-4a88-bccf-69ff6ed8a995 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:26.441196 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5954c7c2-7739-4a88-bccf-69ff6ed8a995 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:26.442253 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4280063e-096d-4c5a-bce2-f70261a72544 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:26.442354 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5954c7c2-7739-4a88-bccf-69ff6ed8a995 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:26.442691 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5954c7c2-7739-4a88-bccf-69ff6ed8a995 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:26.700450 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-5954c7c2-7739-4a88-bccf-69ff6ed8a995 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:26.708859 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-5954c7c2-7739-4a88-bccf-69ff6ed8a995 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1363 microversion: 2.1 time: 0.280998 May 25 16:21:26.709767 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 81/160] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:26 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1363 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:26.714870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-17bde905-31c8-4b8f-b981-926e114d3e9b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:26.715692 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-17bde905-31c8-4b8f-b981-926e114d3e9b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:26.722450 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-17bde905-31c8-4b8f-b981-926e114d3e9b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:26.723217 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-17bde905-31c8-4b8f-b981-926e114d3e9b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:26.724254 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-17bde905-31c8-4b8f-b981-926e114d3e9b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:26.724882 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-17bde905-31c8-4b8f-b981-926e114d3e9b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:26.758569 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-4280063e-096d-4c5a-bce2-f70261a72544 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:26.768331 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-4280063e-096d-4c5a-bce2-f70261a72544 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1514 microversion: 2.1 time: 0.361929 May 25 16:21:26.769079 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 80/161] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:26 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1514 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:26.787869 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-7320dc2c-d5d7-4cca-ab5f-da2205f4faad tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:21:26.789802 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-7320dc2c-d5d7-4cca-ab5f-da2205f4faad tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:26.796533 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7320dc2c-d5d7-4cca-ab5f-da2205f4faad tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:26.797028 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7320dc2c-d5d7-4cca-ab5f-da2205f4faad tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:26.797950 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7320dc2c-d5d7-4cca-ab5f-da2205f4faad tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:26.798389 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7320dc2c-d5d7-4cca-ab5f-da2205f4faad tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:26.865743 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.objects.instance [None req-7320dc2c-d5d7-4cca-ab5f-da2205f4faad tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lazy-loading 'flavor' on Instance uuid 756c834d-49bb-4cd7-b5c7-7140c66b0d0c {{(pid=117509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:21:26.942948 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-17bde905-31c8-4b8f-b981-926e114d3e9b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:26.959551 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-17bde905-31c8-4b8f-b981-926e114d3e9b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:26.961260 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-17bde905-31c8-4b8f-b981-926e114d3e9b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:26.962467 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-17bde905-31c8-4b8f-b981-926e114d3e9b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1405 microversion: 2.20 time: 0.251568 May 25 16:21:26.963349 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 82/162] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:21:26 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1405 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:21:27.001877 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-f871b027-4865-4743-9406-c43064cc8bed tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:27.002489 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-f871b027-4865-4743-9406-c43064cc8bed tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:27.012024 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f871b027-4865-4743-9406-c43064cc8bed tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:27.016887 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f871b027-4865-4743-9406-c43064cc8bed tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:27.017878 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f871b027-4865-4743-9406-c43064cc8bed tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:27.018464 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f871b027-4865-4743-9406-c43064cc8bed tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:27.061165 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-7320dc2c-d5d7-4cca-ab5f-da2205f4faad tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "POST /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c/action" status: 200 len: 32 microversion: 2.1 time: 0.275355 May 25 16:21:27.061826 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 81/163] 10.222.0.42 () {60 vars in 1277 bytes} [Wed May 25 16:21:26 2022] POST /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c/action => generated 32 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 25 16:21:27.079603 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-5520ba0c-d21a-4019-8df8-3d54303aba6b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:27.080328 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-5520ba0c-d21a-4019-8df8-3d54303aba6b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:27.092308 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5520ba0c-d21a-4019-8df8-3d54303aba6b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:27.100036 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5520ba0c-d21a-4019-8df8-3d54303aba6b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:27.100780 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5520ba0c-d21a-4019-8df8-3d54303aba6b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:27.104105 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5520ba0c-d21a-4019-8df8-3d54303aba6b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:27.501263 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-f871b027-4865-4743-9406-c43064cc8bed tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18cd966ad655466e85930f7c505fb360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5ee0d2e59647dc98721de1b8dfb4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:27.561742 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-f871b027-4865-4743-9406-c43064cc8bed tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 200 len: 1553 microversion: 2.1 time: 0.566169 May 25 16:21:27.568859 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 83/164] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:26 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 1553 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:21:27.607952 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-5520ba0c-d21a-4019-8df8-3d54303aba6b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:27.620046 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-5520ba0c-d21a-4019-8df8-3d54303aba6b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.551392 May 25 16:21:27.620637 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 82/165] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:27 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:27.726656 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-50f1b0de-e338-42f3-9be5-9e68942b53a8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:27.727777 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-50f1b0de-e338-42f3-9be5-9e68942b53a8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:27.740456 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-50f1b0de-e338-42f3-9be5-9e68942b53a8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:27.741554 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-50f1b0de-e338-42f3-9be5-9e68942b53a8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:27.743215 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-50f1b0de-e338-42f3-9be5-9e68942b53a8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:27.743849 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-50f1b0de-e338-42f3-9be5-9e68942b53a8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:27.983863 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-88feb4a3-7c63-458b-aac9-72d2c6eff4b9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:27.985596 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-88feb4a3-7c63-458b-aac9-72d2c6eff4b9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:27.999197 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-88feb4a3-7c63-458b-aac9-72d2c6eff4b9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:27.999818 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-88feb4a3-7c63-458b-aac9-72d2c6eff4b9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:28.001619 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-88feb4a3-7c63-458b-aac9-72d2c6eff4b9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:28.002104 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-88feb4a3-7c63-458b-aac9-72d2c6eff4b9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:28.024452 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-50f1b0de-e338-42f3-9be5-9e68942b53a8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:28.039293 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-50f1b0de-e338-42f3-9be5-9e68942b53a8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1363 microversion: 2.1 time: 0.315068 May 25 16:21:28.041568 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 84/166] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:27 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1363 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:28.180902 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-271b03e3-1297-4e09-a71c-86ca5cbec43e req-fbd69f9e-e807-4cb0-967b-5dae03820dbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f33f1186-4082-43e1-878c-77a547575727", "name": "network-vif-deleted", "tag": "896b3b44-139e-492c-954c-cf69765ec184"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:21:28.195499 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-271b03e3-1297-4e09-a71c-86ca5cbec43e req-fbd69f9e-e807-4cb0-967b-5dae03820dbe service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:28.196446 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-271b03e3-1297-4e09-a71c-86ca5cbec43e req-fbd69f9e-e807-4cb0-967b-5dae03820dbe service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:28.213315 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-271b03e3-1297-4e09-a71c-86ca5cbec43e req-fbd69f9e-e807-4cb0-967b-5dae03820dbe service nova] Creating event network-vif-deleted:896b3b44-139e-492c-954c-cf69765ec184 for instance f33f1186-4082-43e1-878c-77a547575727 on hv-cinder-84327 May 25 16:21:28.220973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-271b03e3-1297-4e09-a71c-86ca5cbec43e req-fbd69f9e-e807-4cb0-967b-5dae03820dbe service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048137 May 25 16:21:28.221979 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 85/167] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:21:28.248855 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-88feb4a3-7c63-458b-aac9-72d2c6eff4b9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:28.260559 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-88feb4a3-7c63-458b-aac9-72d2c6eff4b9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:28.263410 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-88feb4a3-7c63-458b-aac9-72d2c6eff4b9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:28.264736 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-88feb4a3-7c63-458b-aac9-72d2c6eff4b9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1405 microversion: 2.20 time: 0.287234 May 25 16:21:28.265652 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 83/168] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:21:27 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1405 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:21:28.591779 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-dc8a93cc-44df-4a4e-92e7-00260a539833 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:28.593165 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-dc8a93cc-44df-4a4e-92e7-00260a539833 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:28.600045 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dc8a93cc-44df-4a4e-92e7-00260a539833 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:28.600564 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dc8a93cc-44df-4a4e-92e7-00260a539833 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:28.605580 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dc8a93cc-44df-4a4e-92e7-00260a539833 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:28.606055 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dc8a93cc-44df-4a4e-92e7-00260a539833 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:28.638111 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-79063491-785f-4887-952e-549aa6299a41 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:28.639481 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-79063491-785f-4887-952e-549aa6299a41 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:28.656797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-79063491-785f-4887-952e-549aa6299a41 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:28.657536 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-79063491-785f-4887-952e-549aa6299a41 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:28.658496 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-79063491-785f-4887-952e-549aa6299a41 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:28.659081 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-79063491-785f-4887-952e-549aa6299a41 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:28.685266 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-dc8a93cc-44df-4a4e-92e7-00260a539833 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18cd966ad655466e85930f7c505fb360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5ee0d2e59647dc98721de1b8dfb4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:28.694372 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-dc8a93cc-44df-4a4e-92e7-00260a539833 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 200 len: 1345 microversion: 2.1 time: 0.108171 May 25 16:21:28.695007 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 86/169] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:28 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 1345 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:29.027719 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-79063491-785f-4887-952e-549aa6299a41 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:29.035846 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-79063491-785f-4887-952e-549aa6299a41 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.401407 May 25 16:21:29.044869 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 84/170] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:28 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:21:29.060592 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-9644de3b-8a3a-4d30-a0d3-2fb840a0196c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:29.061196 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-9644de3b-8a3a-4d30-a0d3-2fb840a0196c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:29.068061 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9644de3b-8a3a-4d30-a0d3-2fb840a0196c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:29.068662 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9644de3b-8a3a-4d30-a0d3-2fb840a0196c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:29.070383 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9644de3b-8a3a-4d30-a0d3-2fb840a0196c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:29.071517 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9644de3b-8a3a-4d30-a0d3-2fb840a0196c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:29.283676 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-0af9805f-be15-4359-a68d-3898151a827f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:29.284542 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-0af9805f-be15-4359-a68d-3898151a827f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:29.293214 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0af9805f-be15-4359-a68d-3898151a827f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:29.293668 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0af9805f-be15-4359-a68d-3898151a827f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:29.294477 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0af9805f-be15-4359-a68d-3898151a827f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:29.295075 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0af9805f-be15-4359-a68d-3898151a827f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:29.419930 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-9644de3b-8a3a-4d30-a0d3-2fb840a0196c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:29.427704 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-9644de3b-8a3a-4d30-a0d3-2fb840a0196c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1363 microversion: 2.1 time: 0.371897 May 25 16:21:29.428284 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 87/171] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:29 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1363 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:29.493355 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-0af9805f-be15-4359-a68d-3898151a827f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:29.501893 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-0af9805f-be15-4359-a68d-3898151a827f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:29.503308 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-0af9805f-be15-4359-a68d-3898151a827f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:29.504435 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-0af9805f-be15-4359-a68d-3898151a827f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1597 microversion: 2.20 time: 0.224607 May 25 16:21:29.504983 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 85/172] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:21:29 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1597 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:21:29.523460 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-4af5322d-ef68-4683-97ad-96c85a453ce2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:29.523958 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-4af5322d-ef68-4683-97ad-96c85a453ce2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:29.532439 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4af5322d-ef68-4683-97ad-96c85a453ce2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:29.533450 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4af5322d-ef68-4683-97ad-96c85a453ce2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:29.534578 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4af5322d-ef68-4683-97ad-96c85a453ce2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:29.535015 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4af5322d-ef68-4683-97ad-96c85a453ce2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:29.626228 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-4af5322d-ef68-4683-97ad-96c85a453ce2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.106894 May 25 16:21:29.627475 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 88/173] 10.222.0.42 () {60 vars in 1315 bytes} [Wed May 25 16:21:29 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:21:29.728842 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-5ace4521-e316-4fa0-a6bb-1be3cc61f572 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:29.728842 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-5ace4521-e316-4fa0-a6bb-1be3cc61f572 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:29.733189 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5ace4521-e316-4fa0-a6bb-1be3cc61f572 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:29.733823 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5ace4521-e316-4fa0-a6bb-1be3cc61f572 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:29.734766 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5ace4521-e316-4fa0-a6bb-1be3cc61f572 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:29.735491 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5ace4521-e316-4fa0-a6bb-1be3cc61f572 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:29.770367 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:21:30.055068 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-07b17296-f3c7-46c4-b14f-766536f73c0c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:30.056250 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-07b17296-f3c7-46c4-b14f-766536f73c0c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:30.067904 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-07b17296-f3c7-46c4-b14f-766536f73c0c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:30.069560 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-07b17296-f3c7-46c4-b14f-766536f73c0c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:30.072467 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-07b17296-f3c7-46c4-b14f-766536f73c0c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:30.082411 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-07b17296-f3c7-46c4-b14f-766536f73c0c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:30.112722 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-5ace4521-e316-4fa0-a6bb-1be3cc61f572 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18cd966ad655466e85930f7c505fb360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5ee0d2e59647dc98721de1b8dfb4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:30.127496 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-5ace4521-e316-4fa0-a6bb-1be3cc61f572 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 200 len: 1345 microversion: 2.1 time: 0.419528 May 25 16:21:30.128548 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 86/174] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:29 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 1345 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:30.416081 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-07b17296-f3c7-46c4-b14f-766536f73c0c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:30.425105 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-07b17296-f3c7-46c4-b14f-766536f73c0c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.376110 May 25 16:21:30.425785 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 89/175] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:30 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:30.444168 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-a4522f07-424b-4fa5-a74e-2126c787e421 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:30.445852 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-a4522f07-424b-4fa5-a74e-2126c787e421 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:30.452176 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a4522f07-424b-4fa5-a74e-2126c787e421 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:30.452620 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a4522f07-424b-4fa5-a74e-2126c787e421 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:30.453394 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a4522f07-424b-4fa5-a74e-2126c787e421 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:30.453876 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a4522f07-424b-4fa5-a74e-2126c787e421 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:30.892098 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-a4522f07-424b-4fa5-a74e-2126c787e421 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:30.904763 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-a4522f07-424b-4fa5-a74e-2126c787e421 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1549 microversion: 2.1 time: 0.464324 May 25 16:21:30.918962 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 87/176] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:30 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1549 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:30.925779 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-263558c4-10d8-4360-baed-caa52824a043 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:30.927089 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-263558c4-10d8-4360-baed-caa52824a043 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:30.941516 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-263558c4-10d8-4360-baed-caa52824a043 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:30.942200 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-263558c4-10d8-4360-baed-caa52824a043 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:30.944397 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-263558c4-10d8-4360-baed-caa52824a043 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:30.946403 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-263558c4-10d8-4360-baed-caa52824a043 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:31.140365 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-263558c4-10d8-4360-baed-caa52824a043 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.220861 May 25 16:21:31.141813 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 90/177] 10.222.0.42 () {58 vars in 1274 bytes} [Wed May 25 16:21:30 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f/os-interface => generated 284 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:21:31.146503 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-fe0b5502-8a9a-4ad2-8d12-ddec13b18f7c tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:31.147124 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-fe0b5502-8a9a-4ad2-8d12-ddec13b18f7c tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:31.155837 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fe0b5502-8a9a-4ad2-8d12-ddec13b18f7c tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:31.156293 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fe0b5502-8a9a-4ad2-8d12-ddec13b18f7c tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:31.157265 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fe0b5502-8a9a-4ad2-8d12-ddec13b18f7c tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:31.157881 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fe0b5502-8a9a-4ad2-8d12-ddec13b18f7c tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:31.192511 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fe0b5502-8a9a-4ad2-8d12-ddec13b18f7c tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:31.192744 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fe0b5502-8a9a-4ad2-8d12-ddec13b18f7c tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:31.193365 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.objects.instance [None req-fe0b5502-8a9a-4ad2-8d12-ddec13b18f7c tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lazy-loading 'fault' on Instance uuid f33f1186-4082-43e1-878c-77a547575727 {{(pid=117509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:21:31.272367 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-fe0b5502-8a9a-4ad2-8d12-ddec13b18f7c tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18cd966ad655466e85930f7c505fb360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5ee0d2e59647dc98721de1b8dfb4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:31.281196 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-fe0b5502-8a9a-4ad2-8d12-ddec13b18f7c tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 200 len: 1350 microversion: 2.1 time: 0.140766 May 25 16:21:31.282264 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 88/178] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:31 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 1350 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:21:31.442972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-a6832724-9d5a-49dc-a6f6-680fed643191 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:31.444715 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-a6832724-9d5a-49dc-a6f6-680fed643191 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:31.451447 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a6832724-9d5a-49dc-a6f6-680fed643191 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:31.452265 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a6832724-9d5a-49dc-a6f6-680fed643191 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:31.453315 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a6832724-9d5a-49dc-a6f6-680fed643191 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:31.454243 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a6832724-9d5a-49dc-a6f6-680fed643191 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:31.803643 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-a6832724-9d5a-49dc-a6f6-680fed643191 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:31.821164 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-a6832724-9d5a-49dc-a6f6-680fed643191 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.380798 May 25 16:21:31.823197 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 91/179] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:31 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:31.901768 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-eeef2f8e-581a-48e2-982c-539198d7c9c8 req-c18e1a41-628a-40a9-b1a3-1ccfb2b95d52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3da72ce-f083-455e-ae40-9530c53126ef", "tag": "81d48be3-f76c-4118-bcaa-79360428da5a"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:21:31.912443 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-eeef2f8e-581a-48e2-982c-539198d7c9c8 req-c18e1a41-628a-40a9-b1a3-1ccfb2b95d52 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:31.913537 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-eeef2f8e-581a-48e2-982c-539198d7c9c8 req-c18e1a41-628a-40a9-b1a3-1ccfb2b95d52 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:31.931832 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-eeef2f8e-581a-48e2-982c-539198d7c9c8 req-c18e1a41-628a-40a9-b1a3-1ccfb2b95d52 service nova] Creating event network-changed:81d48be3-f76c-4118-bcaa-79360428da5a for instance d3da72ce-f083-455e-ae40-9530c53126ef on hv-cinder-84327 May 25 16:21:31.937857 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-eeef2f8e-581a-48e2-982c-539198d7c9c8 req-c18e1a41-628a-40a9-b1a3-1ccfb2b95d52 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040296 May 25 16:21:31.938992 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 89/180] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:21:32.300598 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-ec6bda42-1b89-49c1-ad6d-cfd383f59308 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:32.301223 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-ec6bda42-1b89-49c1-ad6d-cfd383f59308 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:32.321040 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ec6bda42-1b89-49c1-ad6d-cfd383f59308 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:32.321519 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ec6bda42-1b89-49c1-ad6d-cfd383f59308 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:32.322816 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ec6bda42-1b89-49c1-ad6d-cfd383f59308 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:32.323455 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ec6bda42-1b89-49c1-ad6d-cfd383f59308 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:32.360149 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.wsgi [None req-ec6bda42-1b89-49c1-ad6d-cfd383f59308 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] HTTP exception thrown: Instance f33f1186-4082-43e1-878c-77a547575727 could not be found. May 25 16:21:32.375984 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-ec6bda42-1b89-49c1-ad6d-cfd383f59308 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Request method failure captured: May 25 16:21:32.375984 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: request: GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 HTTP/1.1 May 25 16:21:32.375984 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept: application/json May 25 16:21:32.375984 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept-Encoding: identity May 25 16:21:32.375984 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Connection: close May 25 16:21:32.375984 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Length: 0 May 25 16:21:32.375984 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Type: application/json May 25 16:21:32.375984 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Host: 10.222.0.42 May 25 16:21:32.375984 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Openstack-System-Scope: None May 25 16:21:32.375984 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: User-Agent: python-urllib3/1.26.9 May 25 16:21:32.375984 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Auth-Token: gAAAAABijldF24s4eF1qu7vlu5Vg7gFwe8idNVVRV8m4-us85oJ-eaTn9XnAItVe5dp9deaNv3w1cLDgM86O2VppzByg91a1Dx3zdoU13fyWBfJphtBv1XrOehrXBxxXCD-cybfQ3HkA3mwxMvQZkyXMcCXrToI7Hg8xYUxLGaUP8jDpdLMjPPY May 25 16:21:32.375984 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Id: None May 25 16:21:32.375984 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Name: None May 25 16:21:32.375984 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Identity-Status: Confirmed May 25 16:21:32.375984 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Is-Admin-Project: True May 25 16:21:32.375984 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Id: default May 25 16:21:32.375984 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Name: Default May 25 16:21:32.375984 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Id: 9b5ee0d2e59647dc98721de1b8dfb4db May 25 16:21:32.375984 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Name: tempest-DeleteServersTestJSON-2140753348 May 25 16:21:32.375984 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Role: reader,member May 25 16:21:32.375984 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Roles: reader,member May 25 16:21:32.377795 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9b5ee0d2e59647dc98721de1b8dfb4db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9b5ee0d2e59647dc98721de1b8dfb4db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9b5ee0d2e59647dc98721de1b8dfb4db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9b5ee0d2e59647dc98721de1b8dfb4db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:21:32.377795 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant: tempest-DeleteServersTestJSON-2140753348 May 25 16:21:32.377795 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Id: 9b5ee0d2e59647dc98721de1b8dfb4db May 25 16:21:32.377795 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Name: tempest-DeleteServersTestJSON-2140753348 May 25 16:21:32.377795 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User: tempest-DeleteServersTestJSON-2140753348-project May 25 16:21:32.377795 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Id: default May 25 16:21:32.377795 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Name: Default May 25 16:21:32.377795 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Id: 18cd966ad655466e85930f7c505fb360 May 25 16:21:32.377795 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Name: tempest-DeleteServersTestJSON-2140753348-project May 25 16:21:32.377795 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: method: > May 25 16:21:32.377795 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: exception: Instance f33f1186-4082-43e1-878c-77a547575727 could not be found. May 25 16:21:32.377795 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: action_args: {'id': 'f33f1186-4082-43e1-878c-77a547575727'} May 25 16:21:32.378592 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:21:32.378592 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:21:32.378592 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:21:32.378592 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:21:32.378592 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:21:32.378592 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:21:32.378592 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:21:32.378592 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:21:32.378592 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:21:32.378592 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:21:32.378592 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f33f1186-4082-43e1-878c-77a547575727 could not be found. May 25 16:21:32.378592 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:21:32.378592 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:21:32.378592 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:21:32.378592 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:21:32.378592 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:21:32.378592 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:21:32.378592 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:21:32.378592 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:21:32.378592 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:21:32.379686 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:21:32.379686 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:21:32.379686 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:21:32.379686 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:21:32.379686 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:21:32.379686 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:21:32.379686 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:21:32.379686 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f33f1186-4082-43e1-878c-77a547575727 could not be found. May 25 16:21:32.379686 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:21:32.379686 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:21:32.379686 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:21:32.379686 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:21:32.379686 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:21:32.379686 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:21:32.379686 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:21:32.379686 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:21:32.379686 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f33f1186-4082-43e1-878c-77a547575727 could not be found. May 25 16:21:32.379686 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:21:32.380717 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-ec6bda42-1b89-49c1-ad6d-cfd383f59308 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Returning 404 to user: Instance f33f1186-4082-43e1-878c-77a547575727 could not be found. {{(pid=117510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:21:32.380717 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-ec6bda42-1b89-49c1-ad6d-cfd383f59308 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 404 len: 111 microversion: 2.1 time: 0.084013 May 25 16:21:32.381570 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 92/181] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:32 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:21:32.626290 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-5f5caa6b-6986-4b00-ab41-765e3e7c2871 req-6fcf3535-5100-42e4-881b-70555bd7cad3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c525fad-3e59-4bcd-9263-cf3a13d13e3f", "tag": "5d7ffb26-b14c-4496-a249-7c6754e10040"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:21:32.635649 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-3fde2bc6-f22a-47e7-8d55-017ef5f6bfb2 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:32.636663 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-3fde2bc6-f22a-47e7-8d55-017ef5f6bfb2 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:32.652820 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-5f5caa6b-6986-4b00-ab41-765e3e7c2871 req-6fcf3535-5100-42e4-881b-70555bd7cad3 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:32.653264 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-5f5caa6b-6986-4b00-ab41-765e3e7c2871 req-6fcf3535-5100-42e4-881b-70555bd7cad3 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:32.657613 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3fde2bc6-f22a-47e7-8d55-017ef5f6bfb2 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:32.658317 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3fde2bc6-f22a-47e7-8d55-017ef5f6bfb2 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:32.659650 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3fde2bc6-f22a-47e7-8d55-017ef5f6bfb2 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:32.669388 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3fde2bc6-f22a-47e7-8d55-017ef5f6bfb2 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:32.685603 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-5f5caa6b-6986-4b00-ab41-765e3e7c2871 req-6fcf3535-5100-42e4-881b-70555bd7cad3 service nova] Creating event network-changed:5d7ffb26-b14c-4496-a249-7c6754e10040 for instance 9c525fad-3e59-4bcd-9263-cf3a13d13e3f on hv-cinder-84327 May 25 16:21:32.689544 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.wsgi [None req-3fde2bc6-f22a-47e7-8d55-017ef5f6bfb2 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] HTTP exception thrown: Instance f33f1186-4082-43e1-878c-77a547575727 could not be found. May 25 16:21:32.695516 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-5f5caa6b-6986-4b00-ab41-765e3e7c2871 req-6fcf3535-5100-42e4-881b-70555bd7cad3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072196 May 25 16:21:32.702696 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-3fde2bc6-f22a-47e7-8d55-017ef5f6bfb2 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Request method failure captured: May 25 16:21:32.702696 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: request: GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727/os-volume_attachments HTTP/1.1 May 25 16:21:32.702696 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept: application/json May 25 16:21:32.702696 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept-Encoding: identity May 25 16:21:32.702696 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Connection: close May 25 16:21:32.702696 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Length: 0 May 25 16:21:32.702696 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Type: application/json May 25 16:21:32.702696 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Host: 10.222.0.42 May 25 16:21:32.702696 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Openstack-System-Scope: None May 25 16:21:32.702696 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: User-Agent: python-urllib3/1.26.9 May 25 16:21:32.702696 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Auth-Token: gAAAAABijldF24s4eF1qu7vlu5Vg7gFwe8idNVVRV8m4-us85oJ-eaTn9XnAItVe5dp9deaNv3w1cLDgM86O2VppzByg91a1Dx3zdoU13fyWBfJphtBv1XrOehrXBxxXCD-cybfQ3HkA3mwxMvQZkyXMcCXrToI7Hg8xYUxLGaUP8jDpdLMjPPY May 25 16:21:32.702696 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Id: None May 25 16:21:32.702696 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Name: None May 25 16:21:32.702696 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Identity-Status: Confirmed May 25 16:21:32.702696 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Is-Admin-Project: True May 25 16:21:32.702696 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Id: default May 25 16:21:32.702696 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Name: Default May 25 16:21:32.702696 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Id: 9b5ee0d2e59647dc98721de1b8dfb4db May 25 16:21:32.702696 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Name: tempest-DeleteServersTestJSON-2140753348 May 25 16:21:32.702696 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Role: reader,member May 25 16:21:32.702696 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Roles: reader,member May 25 16:21:32.704490 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9b5ee0d2e59647dc98721de1b8dfb4db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9b5ee0d2e59647dc98721de1b8dfb4db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9b5ee0d2e59647dc98721de1b8dfb4db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9b5ee0d2e59647dc98721de1b8dfb4db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:21:32.704490 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant: tempest-DeleteServersTestJSON-2140753348 May 25 16:21:32.704490 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Id: 9b5ee0d2e59647dc98721de1b8dfb4db May 25 16:21:32.704490 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Name: tempest-DeleteServersTestJSON-2140753348 May 25 16:21:32.704490 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User: tempest-DeleteServersTestJSON-2140753348-project May 25 16:21:32.704490 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Id: default May 25 16:21:32.704490 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Name: Default May 25 16:21:32.704490 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Id: 18cd966ad655466e85930f7c505fb360 May 25 16:21:32.704490 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Name: tempest-DeleteServersTestJSON-2140753348-project May 25 16:21:32.704490 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: method: > May 25 16:21:32.704490 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: exception: Instance f33f1186-4082-43e1-878c-77a547575727 could not be found. May 25 16:21:32.704490 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: action_args: {'server_id': 'f33f1186-4082-43e1-878c-77a547575727'} May 25 16:21:32.705363 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:21:32.705363 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:21:32.705363 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:21:32.705363 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:21:32.705363 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:21:32.705363 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:21:32.705363 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:21:32.705363 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:21:32.705363 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:21:32.705363 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:21:32.705363 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f33f1186-4082-43e1-878c-77a547575727 could not be found. May 25 16:21:32.705363 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:21:32.705363 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:21:32.705363 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:21:32.705363 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:21:32.705363 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:21:32.705363 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:21:32.705363 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:21:32.705363 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:21:32.705363 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:21:32.707330 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:21:32.707330 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 25 16:21:32.707330 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 16:21:32.707330 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 25 16:21:32.707330 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 16:21:32.707330 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 25 16:21:32.707330 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 25 16:21:32.707330 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:21:32.707330 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:21:32.707330 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f33f1186-4082-43e1-878c-77a547575727 could not be found. May 25 16:21:32.707330 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:21:32.707330 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:21:32.707330 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:21:32.707330 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:21:32.707330 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:21:32.707330 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:21:32.707330 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:21:32.707330 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:21:32.707330 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f33f1186-4082-43e1-878c-77a547575727 could not be found. May 25 16:21:32.707330 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:21:32.709189 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 90/182] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:21:32.710064 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-3fde2bc6-f22a-47e7-8d55-017ef5f6bfb2 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Returning 404 to user: Instance f33f1186-4082-43e1-878c-77a547575727 could not be found. {{(pid=117510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:21:32.711809 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-3fde2bc6-f22a-47e7-8d55-017ef5f6bfb2 tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.080217 May 25 16:21:32.712680 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 93/183] 10.222.0.42 () {58 vars in 1301 bytes} [Wed May 25 16:21:32 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727/os-volume_attachments => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 16:21:32.841417 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-01ffd4f6-15a6-4ec4-a714-190979c1db67 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:32.842252 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-01ffd4f6-15a6-4ec4-a714-190979c1db67 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:32.852787 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-01ffd4f6-15a6-4ec4-a714-190979c1db67 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:32.853609 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-01ffd4f6-15a6-4ec4-a714-190979c1db67 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:32.855238 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-01ffd4f6-15a6-4ec4-a714-190979c1db67 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:32.856103 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-01ffd4f6-15a6-4ec4-a714-190979c1db67 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:33.018396 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-01ffd4f6-15a6-4ec4-a714-190979c1db67 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:33.029409 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-01ffd4f6-15a6-4ec4-a714-190979c1db67 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.193720 May 25 16:21:33.030168 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 91/184] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:32 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:34.046731 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-7be98a7b-c5a7-4d73-acef-7536bfe090b7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:34.048341 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-7be98a7b-c5a7-4d73-acef-7536bfe090b7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:34.055469 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7be98a7b-c5a7-4d73-acef-7536bfe090b7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:34.055963 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7be98a7b-c5a7-4d73-acef-7536bfe090b7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:34.056681 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7be98a7b-c5a7-4d73-acef-7536bfe090b7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:34.057120 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7be98a7b-c5a7-4d73-acef-7536bfe090b7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:34.203347 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-7be98a7b-c5a7-4d73-acef-7536bfe090b7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:34.221347 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-7be98a7b-c5a7-4d73-acef-7536bfe090b7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.178351 May 25 16:21:34.222171 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 94/185] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:34 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:35.240564 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-da96ee2f-8560-4d43-b11b-6babb7d43eca tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:35.242439 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-da96ee2f-8560-4d43-b11b-6babb7d43eca tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:35.251271 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-da96ee2f-8560-4d43-b11b-6babb7d43eca tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:35.251942 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-da96ee2f-8560-4d43-b11b-6babb7d43eca tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:35.252875 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-da96ee2f-8560-4d43-b11b-6babb7d43eca tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:35.253373 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-da96ee2f-8560-4d43-b11b-6babb7d43eca tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:35.548935 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-da96ee2f-8560-4d43-b11b-6babb7d43eca tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:35.558667 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-da96ee2f-8560-4d43-b11b-6babb7d43eca tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.323233 May 25 16:21:35.559582 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 92/186] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:35 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:36.065344 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-37665fd2-c641-40db-9b3e-28cac244315d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:36.065925 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-37665fd2-c641-40db-9b3e-28cac244315d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:36.073306 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-37665fd2-c641-40db-9b3e-28cac244315d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:36.074027 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-37665fd2-c641-40db-9b3e-28cac244315d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:36.075004 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-37665fd2-c641-40db-9b3e-28cac244315d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:36.075858 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-37665fd2-c641-40db-9b3e-28cac244315d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:36.102323 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.wsgi [None req-37665fd2-c641-40db-9b3e-28cac244315d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] HTTP exception thrown: Instance f33f1186-4082-43e1-878c-77a547575727 could not be found. May 25 16:21:36.103870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-37665fd2-c641-40db-9b3e-28cac244315d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Request method failure captured: May 25 16:21:36.103870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: request: DELETE /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 HTTP/1.1 May 25 16:21:36.103870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept: application/json May 25 16:21:36.103870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept-Encoding: identity May 25 16:21:36.103870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Connection: close May 25 16:21:36.103870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Length: 0 May 25 16:21:36.103870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Type: application/json May 25 16:21:36.103870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Host: 10.222.0.42 May 25 16:21:36.103870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Openstack-System-Scope: None May 25 16:21:36.103870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: User-Agent: python-urllib3/1.26.9 May 25 16:21:36.103870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Auth-Token: gAAAAABijldF24s4eF1qu7vlu5Vg7gFwe8idNVVRV8m4-us85oJ-eaTn9XnAItVe5dp9deaNv3w1cLDgM86O2VppzByg91a1Dx3zdoU13fyWBfJphtBv1XrOehrXBxxXCD-cybfQ3HkA3mwxMvQZkyXMcCXrToI7Hg8xYUxLGaUP8jDpdLMjPPY May 25 16:21:36.103870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Id: None May 25 16:21:36.103870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Name: None May 25 16:21:36.103870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Identity-Status: Confirmed May 25 16:21:36.103870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Is-Admin-Project: True May 25 16:21:36.103870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Id: default May 25 16:21:36.103870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Name: Default May 25 16:21:36.103870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Id: 9b5ee0d2e59647dc98721de1b8dfb4db May 25 16:21:36.103870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Name: tempest-DeleteServersTestJSON-2140753348 May 25 16:21:36.103870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Role: reader,member May 25 16:21:36.103870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Roles: reader,member May 25 16:21:36.105064 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9b5ee0d2e59647dc98721de1b8dfb4db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9b5ee0d2e59647dc98721de1b8dfb4db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9b5ee0d2e59647dc98721de1b8dfb4db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9b5ee0d2e59647dc98721de1b8dfb4db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:21:36.105064 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant: tempest-DeleteServersTestJSON-2140753348 May 25 16:21:36.105064 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Id: 9b5ee0d2e59647dc98721de1b8dfb4db May 25 16:21:36.105064 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Name: tempest-DeleteServersTestJSON-2140753348 May 25 16:21:36.105064 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User: tempest-DeleteServersTestJSON-2140753348-project May 25 16:21:36.105064 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Id: default May 25 16:21:36.105064 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Name: Default May 25 16:21:36.105064 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Id: 18cd966ad655466e85930f7c505fb360 May 25 16:21:36.105064 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Name: tempest-DeleteServersTestJSON-2140753348-project May 25 16:21:36.105064 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: method: > May 25 16:21:36.105064 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: exception: Instance f33f1186-4082-43e1-878c-77a547575727 could not be found. May 25 16:21:36.105064 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: action_args: {'id': 'f33f1186-4082-43e1-878c-77a547575727'} May 25 16:21:36.105826 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:21:36.105826 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:21:36.105826 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:21:36.105826 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:21:36.105826 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:21:36.105826 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:21:36.105826 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:21:36.105826 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:21:36.105826 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:21:36.105826 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:21:36.105826 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f33f1186-4082-43e1-878c-77a547575727 could not be found. May 25 16:21:36.105826 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:21:36.105826 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:21:36.105826 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:21:36.105826 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:21:36.105826 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:21:36.105826 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:21:36.105826 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:21:36.105826 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:21:36.105826 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:21:36.107145 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:21:36.107145 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 16:21:36.107145 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 16:21:36.107145 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 16:21:36.107145 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 16:21:36.107145 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:21:36.107145 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:21:36.107145 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:21:36.107145 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:21:36.107145 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f33f1186-4082-43e1-878c-77a547575727 could not be found. May 25 16:21:36.107145 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:21:36.107145 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:21:36.107145 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:21:36.107145 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:21:36.107145 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:21:36.107145 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:21:36.107145 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:21:36.107145 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:21:36.107145 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f33f1186-4082-43e1-878c-77a547575727 could not be found. May 25 16:21:36.107145 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:21:36.108570 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-37665fd2-c641-40db-9b3e-28cac244315d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Returning 404 to user: Instance f33f1186-4082-43e1-878c-77a547575727 could not be found. {{(pid=117510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:21:36.108570 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-37665fd2-c641-40db-9b3e-28cac244315d tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 404 len: 111 microversion: 2.1 time: 0.044057 May 25 16:21:36.108874 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 95/187] 10.222.0.42 () {58 vars in 1238 bytes} [Wed May 25 16:21:36 2022] DELETE /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:21:36.114685 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-ab37ca32-060f-4080-9c14-88c09dc82b2e tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:36.115472 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-ab37ca32-060f-4080-9c14-88c09dc82b2e tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] [instance: f33f1186-4082-43e1-878c-77a547575727] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:36.122201 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ab37ca32-060f-4080-9c14-88c09dc82b2e tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:36.122656 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ab37ca32-060f-4080-9c14-88c09dc82b2e tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:36.123441 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ab37ca32-060f-4080-9c14-88c09dc82b2e tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:36.123842 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ab37ca32-060f-4080-9c14-88c09dc82b2e tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:36.138889 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.wsgi [None req-ab37ca32-060f-4080-9c14-88c09dc82b2e tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] HTTP exception thrown: Instance f33f1186-4082-43e1-878c-77a547575727 could not be found. May 25 16:21:36.144968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-ab37ca32-060f-4080-9c14-88c09dc82b2e tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Request method failure captured: May 25 16:21:36.144968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 HTTP/1.1 May 25 16:21:36.144968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:21:36.144968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:21:36.144968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:21:36.144968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 0 May 25 16:21:36.144968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:21:36.144968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:21:36.144968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:21:36.144968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:21:36.144968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijldF24s4eF1qu7vlu5Vg7gFwe8idNVVRV8m4-us85oJ-eaTn9XnAItVe5dp9deaNv3w1cLDgM86O2VppzByg91a1Dx3zdoU13fyWBfJphtBv1XrOehrXBxxXCD-cybfQ3HkA3mwxMvQZkyXMcCXrToI7Hg8xYUxLGaUP8jDpdLMjPPY May 25 16:21:36.144968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:21:36.144968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:21:36.144968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:21:36.144968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:21:36.144968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:21:36.144968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:21:36.144968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: 9b5ee0d2e59647dc98721de1b8dfb4db May 25 16:21:36.144968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-DeleteServersTestJSON-2140753348 May 25 16:21:36.144968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:21:36.144968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:21:36.146442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9b5ee0d2e59647dc98721de1b8dfb4db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9b5ee0d2e59647dc98721de1b8dfb4db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9b5ee0d2e59647dc98721de1b8dfb4db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9b5ee0d2e59647dc98721de1b8dfb4db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:21:36.146442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-DeleteServersTestJSON-2140753348 May 25 16:21:36.146442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: 9b5ee0d2e59647dc98721de1b8dfb4db May 25 16:21:36.146442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-DeleteServersTestJSON-2140753348 May 25 16:21:36.146442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-DeleteServersTestJSON-2140753348-project May 25 16:21:36.146442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:21:36.146442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:21:36.146442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: 18cd966ad655466e85930f7c505fb360 May 25 16:21:36.146442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-DeleteServersTestJSON-2140753348-project May 25 16:21:36.146442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: > May 25 16:21:36.146442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Instance f33f1186-4082-43e1-878c-77a547575727 could not be found. May 25 16:21:36.146442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'id': 'f33f1186-4082-43e1-878c-77a547575727'} May 25 16:21:36.147148 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:21:36.147148 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:21:36.147148 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:21:36.147148 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:21:36.147148 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:21:36.147148 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:21:36.147148 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:21:36.147148 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:21:36.147148 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:21:36.147148 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:21:36.147148 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f33f1186-4082-43e1-878c-77a547575727 could not be found. May 25 16:21:36.147148 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:21:36.147148 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:21:36.147148 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:21:36.147148 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:21:36.147148 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:21:36.147148 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:21:36.147148 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:21:36.147148 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:21:36.147148 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:21:36.149018 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:21:36.149018 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:21:36.149018 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:21:36.149018 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:21:36.149018 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:21:36.149018 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:21:36.149018 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:21:36.149018 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f33f1186-4082-43e1-878c-77a547575727 could not be found. May 25 16:21:36.149018 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:21:36.149018 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:21:36.149018 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:21:36.149018 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:21:36.149018 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:21:36.149018 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:21:36.149018 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:21:36.149018 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:21:36.149018 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f33f1186-4082-43e1-878c-77a547575727 could not be found. May 25 16:21:36.149018 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:21:36.151161 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-ab37ca32-060f-4080-9c14-88c09dc82b2e tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] Returning 404 to user: Instance f33f1186-4082-43e1-878c-77a547575727 could not be found. {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:21:36.151161 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-ab37ca32-060f-4080-9c14-88c09dc82b2e tempest-DeleteServersTestJSON-2140753348 tempest-DeleteServersTestJSON-2140753348-project] 10.222.0.42 "GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727" status: 404 len: 111 microversion: 2.1 time: 0.036554 May 25 16:21:36.151464 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 93/188] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:36 2022] GET /compute/v2.1/servers/f33f1186-4082-43e1-878c-77a547575727 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:21:36.578752 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-e86e82c2-f595-433a-aa28-c16b0e6b89b4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:36.579551 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-e86e82c2-f595-433a-aa28-c16b0e6b89b4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:36.585833 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e86e82c2-f595-433a-aa28-c16b0e6b89b4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:36.586521 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e86e82c2-f595-433a-aa28-c16b0e6b89b4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:36.587329 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e86e82c2-f595-433a-aa28-c16b0e6b89b4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:36.587771 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e86e82c2-f595-433a-aa28-c16b0e6b89b4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:36.902641 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-e86e82c2-f595-433a-aa28-c16b0e6b89b4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:36.915074 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-e86e82c2-f595-433a-aa28-c16b0e6b89b4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.342254 May 25 16:21:36.917138 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 96/189] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:36 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:21:37.933754 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-fa110d61-9fc8-4f65-95f7-623c8f03b86f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:37.934356 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-fa110d61-9fc8-4f65-95f7-623c8f03b86f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:37.940333 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fa110d61-9fc8-4f65-95f7-623c8f03b86f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:37.940773 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fa110d61-9fc8-4f65-95f7-623c8f03b86f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:37.941521 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fa110d61-9fc8-4f65-95f7-623c8f03b86f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:37.941980 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fa110d61-9fc8-4f65-95f7-623c8f03b86f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:38.133674 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-f2944ec8-58bf-4119-a7a9-c169f05b3c84 tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] Action: 'create', calling method: .version_select at 0x7f51eda79790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-103477789"}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:21:38.145275 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-fa110d61-9fc8-4f65-95f7-623c8f03b86f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:38.153551 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-fa110d61-9fc8-4f65-95f7-623c8f03b86f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.224657 May 25 16:21:38.154325 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 94/190] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:37 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:38.417603 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-f2944ec8-58bf-4119-a7a9-c169f05b3c84 tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.415698 May 25 16:21:38.418260 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 97/191] 10.222.0.42 () {60 vars in 1154 bytes} [Wed May 25 16:21:38 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 417 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 25 16:21:38.431214 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-93967be6-75ac-47f5-9d25-919bdbae719a tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] Calling method '.version_select at 0x7f51ee32a5e0>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:38.498051 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-93967be6-75ac-47f5-9d25-919bdbae719a tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/85e412c3-374e-495f-b32e-ac7bdc966bf1" status: 200 len: 344 microversion: 2.1 time: 0.072536 May 25 16:21:38.498638 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 95/192] 10.222.0.42 () {58 vars in 1244 bytes} [Wed May 25 16:21:38 2022] GET /compute/v2.1/os-volumes/85e412c3-374e-495f-b32e-ac7bdc966bf1 => generated 344 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:21:39.174814 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-a16088ba-a008-4d10-906b-6ffeeec0cf3a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:39.175433 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-a16088ba-a008-4d10-906b-6ffeeec0cf3a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:39.177393 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:21:39.185658 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a16088ba-a008-4d10-906b-6ffeeec0cf3a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:39.186132 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a16088ba-a008-4d10-906b-6ffeeec0cf3a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:39.186894 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a16088ba-a008-4d10-906b-6ffeeec0cf3a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:39.187323 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a16088ba-a008-4d10-906b-6ffeeec0cf3a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:39.321908 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-a16088ba-a008-4d10-906b-6ffeeec0cf3a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:39.330187 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-a16088ba-a008-4d10-906b-6ffeeec0cf3a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.163657 May 25 16:21:39.331108 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 98/193] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:39 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:39.510650 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-0b36bd89-d366-4ad4-a498-a58fde9207a1 tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] Calling method '.version_select at 0x7f51ee2eaca0>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:39.559066 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-0b36bd89-d366-4ad4-a498-a58fde9207a1 tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/85e412c3-374e-495f-b32e-ac7bdc966bf1" status: 200 len: 344 microversion: 2.1 time: 0.052294 May 25 16:21:39.559632 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 96/194] 10.222.0.42 () {58 vars in 1244 bytes} [Wed May 25 16:21:39 2022] GET /compute/v2.1/os-volumes/85e412c3-374e-495f-b32e-ac7bdc966bf1 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:21:40.347428 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-4ca9c5cf-f757-474c-8a2e-00fd693730c0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:40.347958 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-4ca9c5cf-f757-474c-8a2e-00fd693730c0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:40.354590 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4ca9c5cf-f757-474c-8a2e-00fd693730c0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:40.355042 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4ca9c5cf-f757-474c-8a2e-00fd693730c0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:40.355803 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4ca9c5cf-f757-474c-8a2e-00fd693730c0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:40.356243 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4ca9c5cf-f757-474c-8a2e-00fd693730c0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:40.492960 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-4ca9c5cf-f757-474c-8a2e-00fd693730c0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:40.500748 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-4ca9c5cf-f757-474c-8a2e-00fd693730c0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.157260 May 25 16:21:40.501316 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 99/195] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:40 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:40.571899 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-8e4f80e2-22ca-4dbe-be2c-ef5751c74111 tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] Calling method '.version_select at 0x7f51ee2eae50>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:40.621181 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-8e4f80e2-22ca-4dbe-be2c-ef5751c74111 tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/85e412c3-374e-495f-b32e-ac7bdc966bf1" status: 200 len: 345 microversion: 2.1 time: 0.053565 May 25 16:21:40.622084 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 97/196] 10.222.0.42 () {58 vars in 1244 bytes} [Wed May 25 16:21:40 2022] GET /compute/v2.1/os-volumes/85e412c3-374e-495f-b32e-ac7bdc966bf1 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:21:40.635424 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-76b18066-1752-46d8-9489-0114f722fa64 tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] Action: 'create', calling method: .version_select at 0x7f51edad9af0>, body: {"snapshot": {"volume_id": "85e412c3-374e-495f-b32e-ac7bdc966bf1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2081277171"}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:21:40.810083 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-76b18066-1752-46d8-9489-0114f722fa64 tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.181188 May 25 16:21:40.810674 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 100/197] 10.222.0.42 () {60 vars in 1161 bytes} [Wed May 25 16:21:40 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:21:40.823152 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-ebc5c243-ff58-4d17-925d-bdd8fd343673 tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] Calling method '.version_select at 0x7f51ee33b430>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:40.859085 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-ebc5c243-ff58-4d17-925d-bdd8fd343673 tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/34b0894e-2f39-4dad-8e24-56ab48904702" status: 200 len: 287 microversion: 2.1 time: 0.039864 May 25 16:21:40.859730 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 98/198] 10.222.0.42 () {58 vars in 1250 bytes} [Wed May 25 16:21:40 2022] GET /compute/v2.1/os-snapshots/34b0894e-2f39-4dad-8e24-56ab48904702 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:21:40.869695 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-06e4f885-94ae-44fe-aaac-0674794e6792 tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] Calling method '.version_select at 0x7f51eda7f940>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:40.910554 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-06e4f885-94ae-44fe-aaac-0674794e6792 tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.044997 May 25 16:21:40.911127 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 101/199] 10.222.0.42 () {58 vars in 1139 bytes} [Wed May 25 16:21:40 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:21:40.922254 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-ec1538b4-61ea-49b6-8792-4c4a7d3b1968 tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] Calling method '.version_select at 0x7f51ee33bb80>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:40.952876 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-ec1538b4-61ea-49b6-8792-4c4a7d3b1968 tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/34b0894e-2f39-4dad-8e24-56ab48904702" status: 200 len: 287 microversion: 2.1 time: 0.034398 May 25 16:21:40.953508 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 99/200] 10.222.0.42 () {58 vars in 1250 bytes} [Wed May 25 16:21:40 2022] GET /compute/v2.1/os-snapshots/34b0894e-2f39-4dad-8e24-56ab48904702 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:21:41.520463 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-83ace1ee-4876-4853-a496-dae3ad8c98db tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:41.521070 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-83ace1ee-4876-4853-a496-dae3ad8c98db tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:41.530205 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-83ace1ee-4876-4853-a496-dae3ad8c98db tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:41.530665 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-83ace1ee-4876-4853-a496-dae3ad8c98db tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:41.531443 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-83ace1ee-4876-4853-a496-dae3ad8c98db tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:41.531882 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-83ace1ee-4876-4853-a496-dae3ad8c98db tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:41.706664 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-83ace1ee-4876-4853-a496-dae3ad8c98db tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:41.714281 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-83ace1ee-4876-4853-a496-dae3ad8c98db tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.197806 May 25 16:21:41.714850 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 102/201] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:41 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:41.967104 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-24297d6e-960e-4690-9c9b-421ce5b1b484 tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] Calling method '.version_select at 0x7f51ee2ead30>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:42.006824 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-24297d6e-960e-4690-9c9b-421ce5b1b484 tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/34b0894e-2f39-4dad-8e24-56ab48904702" status: 200 len: 287 microversion: 2.1 time: 0.045437 May 25 16:21:42.007796 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 100/202] 10.222.0.42 () {58 vars in 1250 bytes} [Wed May 25 16:21:41 2022] GET /compute/v2.1/os-snapshots/34b0894e-2f39-4dad-8e24-56ab48904702 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:21:42.732035 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-b17624ba-0607-491d-af79-6e447741b2c7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:42.732635 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-b17624ba-0607-491d-af79-6e447741b2c7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:42.739199 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b17624ba-0607-491d-af79-6e447741b2c7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:42.739650 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b17624ba-0607-491d-af79-6e447741b2c7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:42.740519 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b17624ba-0607-491d-af79-6e447741b2c7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:42.742005 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b17624ba-0607-491d-af79-6e447741b2c7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:42.746312 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=100 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:21:42.925884 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-b17624ba-0607-491d-af79-6e447741b2c7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:42.934704 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-b17624ba-0607-491d-af79-6e447741b2c7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.206909 May 25 16:21:42.935659 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 103/203] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:42 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:43.018466 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-bb9b4af5-eca0-4ce7-8fc2-2ee1313a22db tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] Calling method '.version_select at 0x7f51ee33ba60>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:43.049778 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-bb9b4af5-eca0-4ce7-8fc2-2ee1313a22db tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/34b0894e-2f39-4dad-8e24-56ab48904702" status: 200 len: 287 microversion: 2.1 time: 0.035050 May 25 16:21:43.050344 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 101/204] 10.222.0.42 () {58 vars in 1250 bytes} [Wed May 25 16:21:43 2022] GET /compute/v2.1/os-snapshots/34b0894e-2f39-4dad-8e24-56ab48904702 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:21:43.952874 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-c8dc9994-32ca-469b-a565-dfb0313ff148 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:43.953521 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-c8dc9994-32ca-469b-a565-dfb0313ff148 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:43.960989 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c8dc9994-32ca-469b-a565-dfb0313ff148 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:43.961443 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c8dc9994-32ca-469b-a565-dfb0313ff148 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:43.962243 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c8dc9994-32ca-469b-a565-dfb0313ff148 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:43.966813 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c8dc9994-32ca-469b-a565-dfb0313ff148 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:44.063050 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-263b2d3c-ae76-43e1-b65b-c2c91bb3d741 tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] Calling method '.version_select at 0x7f51ee33b310>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:44.099379 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-263b2d3c-ae76-43e1-b65b-c2c91bb3d741 tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/34b0894e-2f39-4dad-8e24-56ab48904702" status: 200 len: 287 microversion: 2.1 time: 0.039258 May 25 16:21:44.099379 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 102/205] 10.222.0.42 () {58 vars in 1250 bytes} [Wed May 25 16:21:44 2022] GET /compute/v2.1/os-snapshots/34b0894e-2f39-4dad-8e24-56ab48904702 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:21:44.121591 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-c8dc9994-32ca-469b-a565-dfb0313ff148 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:44.129380 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-c8dc9994-32ca-469b-a565-dfb0313ff148 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.181730 May 25 16:21:44.129986 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 104/206] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:43 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:45.109116 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-d66fcff5-721e-4450-b72f-f7f5222c258c tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] Calling method '.version_select at 0x7f51ee2fd310>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:45.140052 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-d66fcff5-721e-4450-b72f-f7f5222c258c tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/34b0894e-2f39-4dad-8e24-56ab48904702" status: 200 len: 287 microversion: 2.1 time: 0.034827 May 25 16:21:45.140648 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 103/207] 10.222.0.42 () {58 vars in 1250 bytes} [Wed May 25 16:21:45 2022] GET /compute/v2.1/os-snapshots/34b0894e-2f39-4dad-8e24-56ab48904702 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:21:45.146435 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-045f80df-26df-4198-83ea-1a5345219ee4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:45.147045 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-045f80df-26df-4198-83ea-1a5345219ee4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:45.153470 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-045f80df-26df-4198-83ea-1a5345219ee4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:45.153964 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-045f80df-26df-4198-83ea-1a5345219ee4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:45.154730 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-045f80df-26df-4198-83ea-1a5345219ee4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:45.155166 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-045f80df-26df-4198-83ea-1a5345219ee4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:45.280340 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-045f80df-26df-4198-83ea-1a5345219ee4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:45.287957 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-045f80df-26df-4198-83ea-1a5345219ee4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.145011 May 25 16:21:45.288551 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 105/208] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:45 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:46.151818 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-57e25b1c-b030-4a39-8c6c-17172b426fab tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] Calling method '.version_select at 0x7f51ee33b430>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:46.181160 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-57e25b1c-b030-4a39-8c6c-17172b426fab tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/34b0894e-2f39-4dad-8e24-56ab48904702" status: 200 len: 287 microversion: 2.1 time: 0.033971 May 25 16:21:46.181703 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 104/209] 10.222.0.42 () {58 vars in 1250 bytes} [Wed May 25 16:21:46 2022] GET /compute/v2.1/os-snapshots/34b0894e-2f39-4dad-8e24-56ab48904702 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:21:46.304194 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-ba61fb0b-b0d3-44f6-a98e-52dd006adace tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:46.304798 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-ba61fb0b-b0d3-44f6-a98e-52dd006adace tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:46.311399 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ba61fb0b-b0d3-44f6-a98e-52dd006adace tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:46.311852 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ba61fb0b-b0d3-44f6-a98e-52dd006adace tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:46.312616 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ba61fb0b-b0d3-44f6-a98e-52dd006adace tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:46.313055 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ba61fb0b-b0d3-44f6-a98e-52dd006adace tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:46.440880 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-ba61fb0b-b0d3-44f6-a98e-52dd006adace tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:46.449368 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-ba61fb0b-b0d3-44f6-a98e-52dd006adace tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.148992 May 25 16:21:46.449972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 106/210] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:46 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:47.192809 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-9d1ca8c0-c9cc-4dd9-add0-9cc50ddac07c tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] Calling method '.version_select at 0x7f51ee33bc10>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:47.222125 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-9d1ca8c0-c9cc-4dd9-add0-9cc50ddac07c tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/34b0894e-2f39-4dad-8e24-56ab48904702" status: 200 len: 288 microversion: 2.1 time: 0.033161 May 25 16:21:47.222793 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 105/211] 10.222.0.42 () {58 vars in 1250 bytes} [Wed May 25 16:21:47 2022] GET /compute/v2.1/os-snapshots/34b0894e-2f39-4dad-8e24-56ab48904702 => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:21:47.233407 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-5adc9a10-c38e-4d62-bfbb-1a165461f21f tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] Calling method '.version_select at 0x7f51eda225e0>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:47.290979 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-5adc9a10-c38e-4d62-bfbb-1a165461f21f tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/34b0894e-2f39-4dad-8e24-56ab48904702" status: 202 len: 0 microversion: 2.1 time: 0.061403 May 25 16:21:47.291583 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 107/212] 10.222.0.42 () {58 vars in 1253 bytes} [Wed May 25 16:21:47 2022] DELETE /compute/v2.1/os-snapshots/34b0894e-2f39-4dad-8e24-56ab48904702 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:21:47.300222 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-259e990d-8582-4e66-ae71-0d538064761e tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] Calling method '.version_select at 0x7f51ee2eaf70>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:47.330409 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-259e990d-8582-4e66-ae71-0d538064761e tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/34b0894e-2f39-4dad-8e24-56ab48904702" status: 200 len: 287 microversion: 2.1 time: 0.034469 May 25 16:21:47.330972 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 106/213] 10.222.0.42 () {58 vars in 1250 bytes} [Wed May 25 16:21:47 2022] GET /compute/v2.1/os-snapshots/34b0894e-2f39-4dad-8e24-56ab48904702 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:21:47.466743 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-124ab6bb-6240-4f3d-8ec8-5d092e3548e7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:47.467390 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-124ab6bb-6240-4f3d-8ec8-5d092e3548e7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:47.473526 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-124ab6bb-6240-4f3d-8ec8-5d092e3548e7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:47.474024 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-124ab6bb-6240-4f3d-8ec8-5d092e3548e7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:47.474797 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-124ab6bb-6240-4f3d-8ec8-5d092e3548e7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:47.475319 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-124ab6bb-6240-4f3d-8ec8-5d092e3548e7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:47.609462 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-124ab6bb-6240-4f3d-8ec8-5d092e3548e7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:47.617755 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-124ab6bb-6240-4f3d-8ec8-5d092e3548e7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.155751 May 25 16:21:47.618329 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 108/214] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:47 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:48.338704 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_api:SELECT=75 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:21:48.339486 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=41 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:21:48.343781 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-3ffec3e8-523a-4704-b181-61477285e81e tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] Calling method '.version_select at 0x7f51ee2eadc0>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:48.370516 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.wsgi [None req-3ffec3e8-523a-4704-b181-61477285e81e tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] HTTP exception thrown: Snapshot 34b0894e-2f39-4dad-8e24-56ab48904702 could not be found. May 25 16:21:48.374032 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-3ffec3e8-523a-4704-b181-61477285e81e tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] Request method failure captured: May 25 16:21:48.374032 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: GET /compute/v2.1/os-snapshots/34b0894e-2f39-4dad-8e24-56ab48904702 HTTP/1.1 May 25 16:21:48.374032 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:21:48.374032 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:21:48.374032 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:21:48.374032 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 0 May 25 16:21:48.374032 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:21:48.374032 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:21:48.374032 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:21:48.374032 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:21:48.374032 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijleRRS3BdC2mBkvQSokX7verLttRLGwl1BR8M0SlKZhqcuFEr32vSxRHsZcA8y3IowLqRLA8e0jDJRqIF2btHAe0K5hkszaV2S-iW5sa1iphANrVaJH-YoSzXr_U8cKEm12tHH858-tvNqekQL2y_p7oXJr7k0fAFjAUoGqv7TE9rUQ May 25 16:21:48.374032 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:21:48.374032 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:21:48.374032 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:21:48.374032 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:21:48.374032 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:21:48.374032 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:21:48.374032 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: 7a02f436f9a34b29b069ca4e5551f8df May 25 16:21:48.374032 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1870683289 May 25 16:21:48.374032 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:21:48.374032 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:21:48.375379 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7a02f436f9a34b29b069ca4e5551f8df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7a02f436f9a34b29b069ca4e5551f8df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7a02f436f9a34b29b069ca4e5551f8df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7a02f436f9a34b29b069ca4e5551f8df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:21:48.375379 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1870683289 May 25 16:21:48.375379 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: 7a02f436f9a34b29b069ca4e5551f8df May 25 16:21:48.375379 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1870683289 May 25 16:21:48.375379 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-VolumesSnapshotsTestJSON-1870683289-project May 25 16:21:48.375379 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:21:48.375379 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:21:48.375379 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: 569a192bd1084b379aa40ceab7fb1c31 May 25 16:21:48.375379 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1870683289-project May 25 16:21:48.375379 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: May 25 16:21:48.375379 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Snapshot 34b0894e-2f39-4dad-8e24-56ab48904702 could not be found. May 25 16:21:48.375379 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'id': '34b0894e-2f39-4dad-8e24-56ab48904702'} May 25 16:21:48.375379 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:21:48.376180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:21:48.376180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 25 16:21:48.376180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 25 16:21:48.376180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 25 16:21:48.376180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 25 16:21:48.376180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 25 16:21:48.376180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 25 16:21:48.376180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 16:21:48.376180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 16:21:48.376180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 16:21:48.376180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 16:21:48.376180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:21:48.376180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:21:48.376180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:21:48.376180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:21:48.376180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 34b0894e-2f39-4dad-8e24-56ab48904702 could not be found. (HTTP 404) (Request-ID: req-ea7beb14-6565-4d34-85f2-34da9e8cbfc7) May 25 16:21:48.376180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:21:48.376180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:21:48.377208 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:21:48.377208 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:21:48.377208 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 25 16:21:48.377208 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 25 16:21:48.377208 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 16:21:48.377208 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 16:21:48.377208 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 25 16:21:48.377208 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 25 16:21:48.377208 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 16:21:48.377208 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 16:21:48.377208 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 25 16:21:48.377208 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 25 16:21:48.377208 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 25 16:21:48.377208 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 25 16:21:48.377208 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 25 16:21:48.377208 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 25 16:21:48.377208 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 16:21:48.377208 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 16:21:48.377208 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 16:21:48.378351 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 16:21:48.378351 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:21:48.378351 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:21:48.378351 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:21:48.378351 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:21:48.378351 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 34b0894e-2f39-4dad-8e24-56ab48904702 could not be found. May 25 16:21:48.378351 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:21:48.378351 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:21:48.378351 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:21:48.378351 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:21:48.378351 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:21:48.378351 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:21:48.378351 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:21:48.378351 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:21:48.378351 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 16:21:48.378351 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 16:21:48.378351 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:21:48.378351 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:21:48.378351 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 25 16:21:48.378351 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:21:48.379415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 34b0894e-2f39-4dad-8e24-56ab48904702 could not be found. May 25 16:21:48.379415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:21:48.379415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:21:48.379415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:21:48.379415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:21:48.379415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:21:48.379415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:21:48.379415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:21:48.379415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:21:48.379415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 34b0894e-2f39-4dad-8e24-56ab48904702 could not be found. May 25 16:21:48.379415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:21:48.379415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-3ffec3e8-523a-4704-b181-61477285e81e tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] Returning 404 to user: Snapshot 34b0894e-2f39-4dad-8e24-56ab48904702 could not be found. {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:21:48.379415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-3ffec3e8-523a-4704-b181-61477285e81e tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/34b0894e-2f39-4dad-8e24-56ab48904702" status: 404 len: 111 microversion: 2.1 time: 0.037542 May 25 16:21:48.380131 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 107/215] 10.222.0.42 () {58 vars in 1250 bytes} [Wed May 25 16:21:48 2022] GET /compute/v2.1/os-snapshots/34b0894e-2f39-4dad-8e24-56ab48904702 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:21:48.388996 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-92e2037c-880a-4721-b050-87bf89a0f775 tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] Calling method '.version_select at 0x7f51eda92160>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:48.456575 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-92e2037c-880a-4721-b050-87bf89a0f775 tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/85e412c3-374e-495f-b32e-ac7bdc966bf1" status: 202 len: 0 microversion: 2.1 time: 0.071738 May 25 16:21:48.457573 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 109/216] 10.222.0.42 () {58 vars in 1247 bytes} [Wed May 25 16:21:48 2022] DELETE /compute/v2.1/os-volumes/85e412c3-374e-495f-b32e-ac7bdc966bf1 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:21:48.466076 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-1bbeaf73-e90c-4097-83ca-45c5902a1b2b tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] Calling method '.version_select at 0x7f51ee2fdc10>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:48.518320 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-1bbeaf73-e90c-4097-83ca-45c5902a1b2b tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/85e412c3-374e-495f-b32e-ac7bdc966bf1" status: 200 len: 344 microversion: 2.1 time: 0.055962 May 25 16:21:48.518976 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 108/217] 10.222.0.42 () {58 vars in 1244 bytes} [Wed May 25 16:21:48 2022] GET /compute/v2.1/os-volumes/85e412c3-374e-495f-b32e-ac7bdc966bf1 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:21:48.635462 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-d47eceac-c18b-478d-aaf9-3b33c5d9404e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:48.636064 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-d47eceac-c18b-478d-aaf9-3b33c5d9404e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:48.642483 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d47eceac-c18b-478d-aaf9-3b33c5d9404e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:48.642948 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d47eceac-c18b-478d-aaf9-3b33c5d9404e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:48.643764 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d47eceac-c18b-478d-aaf9-3b33c5d9404e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:48.644205 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d47eceac-c18b-478d-aaf9-3b33c5d9404e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:48.822066 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-d47eceac-c18b-478d-aaf9-3b33c5d9404e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:48.830404 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-d47eceac-c18b-478d-aaf9-3b33c5d9404e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.199758 May 25 16:21:48.831085 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 110/218] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:48 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:49.532422 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-c07d4f2b-4fa9-4fac-8aea-dcd11f09093f tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] Calling method '.version_select at 0x7f51ee2ce310>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:49.569709 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.wsgi [None req-c07d4f2b-4fa9-4fac-8aea-dcd11f09093f tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] HTTP exception thrown: Volume 85e412c3-374e-495f-b32e-ac7bdc966bf1 could not be found. May 25 16:21:49.572442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-c07d4f2b-4fa9-4fac-8aea-dcd11f09093f tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] Request method failure captured: May 25 16:21:49.572442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: GET /compute/v2.1/os-volumes/85e412c3-374e-495f-b32e-ac7bdc966bf1 HTTP/1.1 May 25 16:21:49.572442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:21:49.572442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:21:49.572442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:21:49.572442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 0 May 25 16:21:49.572442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:21:49.572442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:21:49.572442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:21:49.572442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:21:49.572442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijleRRS3BdC2mBkvQSokX7verLttRLGwl1BR8M0SlKZhqcuFEr32vSxRHsZcA8y3IowLqRLA8e0jDJRqIF2btHAe0K5hkszaV2S-iW5sa1iphANrVaJH-YoSzXr_U8cKEm12tHH858-tvNqekQL2y_p7oXJr7k0fAFjAUoGqv7TE9rUQ May 25 16:21:49.572442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:21:49.572442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:21:49.572442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:21:49.572442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:21:49.572442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:21:49.572442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:21:49.572442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: 7a02f436f9a34b29b069ca4e5551f8df May 25 16:21:49.572442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1870683289 May 25 16:21:49.572442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:21:49.572442 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:21:49.573815 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7a02f436f9a34b29b069ca4e5551f8df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7a02f436f9a34b29b069ca4e5551f8df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7a02f436f9a34b29b069ca4e5551f8df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7a02f436f9a34b29b069ca4e5551f8df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:21:49.573815 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1870683289 May 25 16:21:49.573815 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: 7a02f436f9a34b29b069ca4e5551f8df May 25 16:21:49.573815 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1870683289 May 25 16:21:49.573815 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-VolumesSnapshotsTestJSON-1870683289-project May 25 16:21:49.573815 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:21:49.573815 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:21:49.573815 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: 569a192bd1084b379aa40ceab7fb1c31 May 25 16:21:49.573815 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1870683289-project May 25 16:21:49.573815 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: May 25 16:21:49.573815 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Volume 85e412c3-374e-495f-b32e-ac7bdc966bf1 could not be found. May 25 16:21:49.573815 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'id': '85e412c3-374e-495f-b32e-ac7bdc966bf1'} May 25 16:21:49.573815 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:21:49.575023 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:21:49.575023 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 16:21:49.575023 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 16:21:49.575023 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 16:21:49.575023 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 16:21:49.575023 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 16:21:49.575023 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 16:21:49.575023 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 16:21:49.575023 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 16:21:49.575023 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 16:21:49.575023 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 16:21:49.575023 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:21:49.575023 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:21:49.575023 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:21:49.575023 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:21:49.575023 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 85e412c3-374e-495f-b32e-ac7bdc966bf1 could not be found. (HTTP 404) (Request-ID: req-a921dcce-419c-4c79-8396-00dec8df8624) May 25 16:21:49.575023 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:21:49.575023 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:21:49.575023 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:21:49.576116 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:21:49.576116 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 25 16:21:49.576116 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 25 16:21:49.576116 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 16:21:49.576116 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 16:21:49.576116 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 16:21:49.576116 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 16:21:49.576116 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 16:21:49.576116 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 16:21:49.576116 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 16:21:49.576116 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 16:21:49.576116 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 16:21:49.576116 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 16:21:49.576116 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 16:21:49.576116 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 16:21:49.576116 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 16:21:49.576116 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 16:21:49.576116 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 16:21:49.576116 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 16:21:49.577104 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:21:49.577104 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:21:49.577104 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:21:49.577104 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:21:49.577104 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 85e412c3-374e-495f-b32e-ac7bdc966bf1 could not be found. May 25 16:21:49.577104 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:21:49.577104 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:21:49.577104 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:21:49.577104 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:21:49.577104 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:21:49.577104 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:21:49.577104 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:21:49.577104 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:21:49.577104 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 16:21:49.577104 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 16:21:49.577104 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:21:49.577104 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:21:49.577104 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 25 16:21:49.577104 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:21:49.578172 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 85e412c3-374e-495f-b32e-ac7bdc966bf1 could not be found. May 25 16:21:49.578172 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:21:49.578172 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:21:49.578172 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:21:49.578172 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:21:49.578172 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:21:49.578172 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:21:49.578172 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:21:49.578172 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:21:49.578172 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 85e412c3-374e-495f-b32e-ac7bdc966bf1 could not be found. May 25 16:21:49.578172 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:21:49.578172 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-c07d4f2b-4fa9-4fac-8aea-dcd11f09093f tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] Returning 404 to user: Volume 85e412c3-374e-495f-b32e-ac7bdc966bf1 could not be found. {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:21:49.582503 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-c07d4f2b-4fa9-4fac-8aea-dcd11f09093f tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/85e412c3-374e-495f-b32e-ac7bdc966bf1" status: 404 len: 109 microversion: 2.1 time: 0.054526 May 25 16:21:49.583239 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 109/219] 10.222.0.42 () {58 vars in 1244 bytes} [Wed May 25 16:21:49 2022] GET /compute/v2.1/os-volumes/85e412c3-374e-495f-b32e-ac7bdc966bf1 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:21:49.597320 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-70e3e33b-5a4c-402b-88a8-7c9e259b05ce tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] Calling method '.version_select at 0x7f51eda92d30>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:49.631135 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.wsgi [None req-70e3e33b-5a4c-402b-88a8-7c9e259b05ce tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] HTTP exception thrown: Volume 85e412c3-374e-495f-b32e-ac7bdc966bf1 could not be found. May 25 16:21:49.633568 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-70e3e33b-5a4c-402b-88a8-7c9e259b05ce tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] Request method failure captured: May 25 16:21:49.633568 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: request: DELETE /compute/v2.1/os-volumes/85e412c3-374e-495f-b32e-ac7bdc966bf1 HTTP/1.1 May 25 16:21:49.633568 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept: application/json May 25 16:21:49.633568 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept-Encoding: identity May 25 16:21:49.633568 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Connection: close May 25 16:21:49.633568 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Length: 0 May 25 16:21:49.633568 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Type: application/json May 25 16:21:49.633568 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Host: 10.222.0.42 May 25 16:21:49.633568 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Openstack-System-Scope: None May 25 16:21:49.633568 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: User-Agent: python-urllib3/1.26.9 May 25 16:21:49.633568 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Auth-Token: gAAAAABijleRRS3BdC2mBkvQSokX7verLttRLGwl1BR8M0SlKZhqcuFEr32vSxRHsZcA8y3IowLqRLA8e0jDJRqIF2btHAe0K5hkszaV2S-iW5sa1iphANrVaJH-YoSzXr_U8cKEm12tHH858-tvNqekQL2y_p7oXJr7k0fAFjAUoGqv7TE9rUQ May 25 16:21:49.633568 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Id: None May 25 16:21:49.633568 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Name: None May 25 16:21:49.633568 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Identity-Status: Confirmed May 25 16:21:49.633568 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Is-Admin-Project: True May 25 16:21:49.633568 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Id: default May 25 16:21:49.633568 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Name: Default May 25 16:21:49.633568 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Id: 7a02f436f9a34b29b069ca4e5551f8df May 25 16:21:49.633568 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1870683289 May 25 16:21:49.633568 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Role: reader,member May 25 16:21:49.633568 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Roles: reader,member May 25 16:21:49.634874 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7a02f436f9a34b29b069ca4e5551f8df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7a02f436f9a34b29b069ca4e5551f8df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7a02f436f9a34b29b069ca4e5551f8df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7a02f436f9a34b29b069ca4e5551f8df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:21:49.634874 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1870683289 May 25 16:21:49.634874 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Id: 7a02f436f9a34b29b069ca4e5551f8df May 25 16:21:49.634874 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1870683289 May 25 16:21:49.634874 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User: tempest-VolumesSnapshotsTestJSON-1870683289-project May 25 16:21:49.634874 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Id: default May 25 16:21:49.634874 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Name: Default May 25 16:21:49.634874 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Id: 569a192bd1084b379aa40ceab7fb1c31 May 25 16:21:49.634874 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1870683289-project May 25 16:21:49.634874 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: method: May 25 16:21:49.634874 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: exception: Volume 85e412c3-374e-495f-b32e-ac7bdc966bf1 could not be found. May 25 16:21:49.634874 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: action_args: {'id': '85e412c3-374e-495f-b32e-ac7bdc966bf1'} May 25 16:21:49.634874 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:21:49.636115 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:21:49.636115 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 16:21:49.636115 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 16:21:49.636115 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 16:21:49.636115 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 16:21:49.636115 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 16:21:49.636115 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 16:21:49.636115 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 16:21:49.636115 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 16:21:49.636115 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 16:21:49.636115 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 16:21:49.636115 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:21:49.636115 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:21:49.636115 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:21:49.636115 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:21:49.636115 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 85e412c3-374e-495f-b32e-ac7bdc966bf1 could not be found. (HTTP 404) (Request-ID: req-824c32d0-e991-4cf8-93ef-48d613dc7266) May 25 16:21:49.636115 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:21:49.636115 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:21:49.636115 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:21:49.637269 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:21:49.637269 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 25 16:21:49.637269 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 25 16:21:49.637269 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 16:21:49.637269 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 16:21:49.637269 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 16:21:49.637269 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 16:21:49.637269 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 16:21:49.637269 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 16:21:49.637269 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 16:21:49.637269 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 16:21:49.637269 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 16:21:49.637269 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 16:21:49.637269 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 16:21:49.637269 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 16:21:49.637269 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 16:21:49.637269 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 16:21:49.637269 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 16:21:49.637269 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 16:21:49.638290 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:21:49.638290 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:21:49.638290 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:21:49.638290 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:21:49.638290 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 85e412c3-374e-495f-b32e-ac7bdc966bf1 could not be found. May 25 16:21:49.638290 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:21:49.638290 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:21:49.638290 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:21:49.638290 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:21:49.638290 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:21:49.638290 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:21:49.638290 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:21:49.638290 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:21:49.638290 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 16:21:49.638290 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 16:21:49.638290 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:21:49.638290 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:21:49.638290 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 25 16:21:49.638290 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:21:49.639464 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 85e412c3-374e-495f-b32e-ac7bdc966bf1 could not be found. May 25 16:21:49.639464 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:21:49.639464 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:21:49.639464 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:21:49.639464 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:21:49.639464 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:21:49.639464 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:21:49.639464 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:21:49.639464 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:21:49.639464 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 85e412c3-374e-495f-b32e-ac7bdc966bf1 could not be found. May 25 16:21:49.639464 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:21:49.639464 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-70e3e33b-5a4c-402b-88a8-7c9e259b05ce tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] Returning 404 to user: Volume 85e412c3-374e-495f-b32e-ac7bdc966bf1 could not be found. {{(pid=117510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:21:49.639464 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-70e3e33b-5a4c-402b-88a8-7c9e259b05ce tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/85e412c3-374e-495f-b32e-ac7bdc966bf1" status: 404 len: 109 microversion: 2.1 time: 0.042084 May 25 16:21:49.639464 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 111/220] 10.222.0.42 () {58 vars in 1247 bytes} [Wed May 25 16:21:49 2022] DELETE /compute/v2.1/os-volumes/85e412c3-374e-495f-b32e-ac7bdc966bf1 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:21:49.643531 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-9f3c15ba-0860-488c-803c-d22a73d35543 tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] Calling method '.version_select at 0x7f51ee33bdc0>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:49.674845 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.wsgi [None req-9f3c15ba-0860-488c-803c-d22a73d35543 tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] HTTP exception thrown: Volume 85e412c3-374e-495f-b32e-ac7bdc966bf1 could not be found. May 25 16:21:49.676778 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-9f3c15ba-0860-488c-803c-d22a73d35543 tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] Request method failure captured: May 25 16:21:49.676778 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: GET /compute/v2.1/os-volumes/85e412c3-374e-495f-b32e-ac7bdc966bf1 HTTP/1.1 May 25 16:21:49.676778 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:21:49.676778 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:21:49.676778 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:21:49.676778 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 0 May 25 16:21:49.676778 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:21:49.676778 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:21:49.676778 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:21:49.676778 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:21:49.676778 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijleRRS3BdC2mBkvQSokX7verLttRLGwl1BR8M0SlKZhqcuFEr32vSxRHsZcA8y3IowLqRLA8e0jDJRqIF2btHAe0K5hkszaV2S-iW5sa1iphANrVaJH-YoSzXr_U8cKEm12tHH858-tvNqekQL2y_p7oXJr7k0fAFjAUoGqv7TE9rUQ May 25 16:21:49.676778 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:21:49.676778 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:21:49.676778 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:21:49.676778 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:21:49.676778 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:21:49.676778 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:21:49.676778 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: 7a02f436f9a34b29b069ca4e5551f8df May 25 16:21:49.676778 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1870683289 May 25 16:21:49.676778 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:21:49.676778 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:21:49.678019 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7a02f436f9a34b29b069ca4e5551f8df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7a02f436f9a34b29b069ca4e5551f8df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7a02f436f9a34b29b069ca4e5551f8df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7a02f436f9a34b29b069ca4e5551f8df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:21:49.678019 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1870683289 May 25 16:21:49.678019 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: 7a02f436f9a34b29b069ca4e5551f8df May 25 16:21:49.678019 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1870683289 May 25 16:21:49.678019 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-VolumesSnapshotsTestJSON-1870683289-project May 25 16:21:49.678019 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:21:49.678019 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:21:49.678019 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: 569a192bd1084b379aa40ceab7fb1c31 May 25 16:21:49.678019 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1870683289-project May 25 16:21:49.678019 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: May 25 16:21:49.678019 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Volume 85e412c3-374e-495f-b32e-ac7bdc966bf1 could not be found. May 25 16:21:49.678019 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'id': '85e412c3-374e-495f-b32e-ac7bdc966bf1'} May 25 16:21:49.678019 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:21:49.678941 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:21:49.678941 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 16:21:49.678941 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 16:21:49.678941 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 16:21:49.678941 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 16:21:49.678941 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 16:21:49.678941 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 16:21:49.678941 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 16:21:49.678941 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 16:21:49.678941 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 16:21:49.678941 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 16:21:49.678941 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:21:49.678941 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:21:49.678941 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:21:49.678941 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:21:49.678941 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 85e412c3-374e-495f-b32e-ac7bdc966bf1 could not be found. (HTTP 404) (Request-ID: req-c5df2f91-8e6c-4a95-a6c4-c869a8f0417c) May 25 16:21:49.678941 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:21:49.678941 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:21:49.678941 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:21:49.680169 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:21:49.680169 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 25 16:21:49.680169 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 25 16:21:49.680169 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 16:21:49.680169 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 16:21:49.680169 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 16:21:49.680169 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 16:21:49.680169 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 16:21:49.680169 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 16:21:49.680169 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 16:21:49.680169 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 16:21:49.680169 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 16:21:49.680169 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 16:21:49.680169 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 16:21:49.680169 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 16:21:49.680169 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 16:21:49.680169 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 16:21:49.680169 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 16:21:49.680169 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 16:21:49.681331 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:21:49.681331 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:21:49.681331 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:21:49.681331 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:21:49.681331 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 85e412c3-374e-495f-b32e-ac7bdc966bf1 could not be found. May 25 16:21:49.681331 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:21:49.681331 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:21:49.681331 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:21:49.681331 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:21:49.681331 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:21:49.681331 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:21:49.681331 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:21:49.681331 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:21:49.681331 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 16:21:49.681331 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 16:21:49.681331 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:21:49.681331 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:21:49.681331 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 25 16:21:49.681331 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:21:49.682735 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 85e412c3-374e-495f-b32e-ac7bdc966bf1 could not be found. May 25 16:21:49.682735 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:21:49.682735 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:21:49.682735 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:21:49.682735 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:21:49.682735 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:21:49.682735 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:21:49.682735 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:21:49.682735 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:21:49.682735 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 85e412c3-374e-495f-b32e-ac7bdc966bf1 could not be found. May 25 16:21:49.682735 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:21:49.682735 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-9f3c15ba-0860-488c-803c-d22a73d35543 tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] Returning 404 to user: Volume 85e412c3-374e-495f-b32e-ac7bdc966bf1 could not be found. {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:21:49.682735 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-9f3c15ba-0860-488c-803c-d22a73d35543 tempest-VolumesSnapshotsTestJSON-1870683289 tempest-VolumesSnapshotsTestJSON-1870683289-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/85e412c3-374e-495f-b32e-ac7bdc966bf1" status: 404 len: 109 microversion: 2.1 time: 0.038724 May 25 16:21:49.682735 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 110/221] 10.222.0.42 () {58 vars in 1244 bytes} [Wed May 25 16:21:49 2022] GET /compute/v2.1/os-volumes/85e412c3-374e-495f-b32e-ac7bdc966bf1 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 16:21:49.849382 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-c40496f4-ec93-4c6d-ae78-56cf785806bb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:49.850471 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-c40496f4-ec93-4c6d-ae78-56cf785806bb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:49.858691 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c40496f4-ec93-4c6d-ae78-56cf785806bb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:49.859148 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c40496f4-ec93-4c6d-ae78-56cf785806bb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:49.859917 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c40496f4-ec93-4c6d-ae78-56cf785806bb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:49.860391 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c40496f4-ec93-4c6d-ae78-56cf785806bb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:50.021619 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-c40496f4-ec93-4c6d-ae78-56cf785806bb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:50.036135 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-c40496f4-ec93-4c6d-ae78-56cf785806bb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.187651 May 25 16:21:50.036742 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 112/222] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:49 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:51.067914 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-f7ae1270-bc1b-4b1c-b239-43ee5887c99b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:51.069507 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-f7ae1270-bc1b-4b1c-b239-43ee5887c99b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:51.080685 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f7ae1270-bc1b-4b1c-b239-43ee5887c99b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:51.083132 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f7ae1270-bc1b-4b1c-b239-43ee5887c99b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:51.084088 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f7ae1270-bc1b-4b1c-b239-43ee5887c99b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:51.085413 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f7ae1270-bc1b-4b1c-b239-43ee5887c99b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:51.228689 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-f7ae1270-bc1b-4b1c-b239-43ee5887c99b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:51.237552 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-f7ae1270-bc1b-4b1c-b239-43ee5887c99b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.187329 May 25 16:21:51.238327 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 111/223] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:51 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:52.255469 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-47515f48-9b5c-4079-9b15-f8ea7efb5eb9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:52.256176 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-47515f48-9b5c-4079-9b15-f8ea7efb5eb9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:52.264514 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-47515f48-9b5c-4079-9b15-f8ea7efb5eb9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:52.265100 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-47515f48-9b5c-4079-9b15-f8ea7efb5eb9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:52.266155 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-47515f48-9b5c-4079-9b15-f8ea7efb5eb9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:52.266863 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-47515f48-9b5c-4079-9b15-f8ea7efb5eb9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:52.490195 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-47515f48-9b5c-4079-9b15-f8ea7efb5eb9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:52.498638 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-47515f48-9b5c-4079-9b15-f8ea7efb5eb9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.247390 May 25 16:21:52.499445 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 113/224] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:52 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:53.516546 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-64b2aa2e-df5d-44c6-aaa2-cc9f520da05f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:53.517156 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-64b2aa2e-df5d-44c6-aaa2-cc9f520da05f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:53.524076 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-64b2aa2e-df5d-44c6-aaa2-cc9f520da05f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:53.524532 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-64b2aa2e-df5d-44c6-aaa2-cc9f520da05f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:53.525613 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-64b2aa2e-df5d-44c6-aaa2-cc9f520da05f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:53.526126 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-64b2aa2e-df5d-44c6-aaa2-cc9f520da05f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:54.017189 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-64b2aa2e-df5d-44c6-aaa2-cc9f520da05f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:54.026029 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-64b2aa2e-df5d-44c6-aaa2-cc9f520da05f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.513234 May 25 16:21:54.026785 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 112/225] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:53 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:55.044807 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-b1ca974a-4c46-4814-bba3-dce6699d74eb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:55.045462 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-b1ca974a-4c46-4814-bba3-dce6699d74eb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:55.052041 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b1ca974a-4c46-4814-bba3-dce6699d74eb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:55.052689 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b1ca974a-4c46-4814-bba3-dce6699d74eb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:55.053773 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b1ca974a-4c46-4814-bba3-dce6699d74eb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:55.054144 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b1ca974a-4c46-4814-bba3-dce6699d74eb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:55.243307 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-b1ca974a-4c46-4814-bba3-dce6699d74eb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:55.251999 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-b1ca974a-4c46-4814-bba3-dce6699d74eb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.210743 May 25 16:21:55.252778 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 114/226] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:55 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:56.269087 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-70561c90-8e76-489d-92a5-bd70c249da71 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:56.269804 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-70561c90-8e76-489d-92a5-bd70c249da71 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:56.278242 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-70561c90-8e76-489d-92a5-bd70c249da71 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:56.278695 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-70561c90-8e76-489d-92a5-bd70c249da71 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:56.281300 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-70561c90-8e76-489d-92a5-bd70c249da71 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:56.281782 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-70561c90-8e76-489d-92a5-bd70c249da71 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:56.609495 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-70561c90-8e76-489d-92a5-bd70c249da71 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:56.619584 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-70561c90-8e76-489d-92a5-bd70c249da71 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.354342 May 25 16:21:56.621027 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 113/227] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:56 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:57.637338 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-b850d5ca-c784-40b5-a77c-168d56668eab tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:57.637957 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-b850d5ca-c784-40b5-a77c-168d56668eab tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:57.646302 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b850d5ca-c784-40b5-a77c-168d56668eab tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:57.646845 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b850d5ca-c784-40b5-a77c-168d56668eab tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:57.648133 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b850d5ca-c784-40b5-a77c-168d56668eab tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:57.648570 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b850d5ca-c784-40b5-a77c-168d56668eab tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:57.883961 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-b850d5ca-c784-40b5-a77c-168d56668eab tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:57.895298 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-b850d5ca-c784-40b5-a77c-168d56668eab tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.261434 May 25 16:21:57.896111 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 115/228] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:57 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:58.918436 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-cd29e0d5-62c4-48e2-94e6-56fc5dad7aa5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:58.920078 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-cd29e0d5-62c4-48e2-94e6-56fc5dad7aa5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:58.937464 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-cd29e0d5-62c4-48e2-94e6-56fc5dad7aa5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:58.938329 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-cd29e0d5-62c4-48e2-94e6-56fc5dad7aa5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:58.940313 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-cd29e0d5-62c4-48e2-94e6-56fc5dad7aa5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:58.941454 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-cd29e0d5-62c4-48e2-94e6-56fc5dad7aa5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:59.142296 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-cd29e0d5-62c4-48e2-94e6-56fc5dad7aa5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:59.167692 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-cd29e0d5-62c4-48e2-94e6-56fc5dad7aa5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.258072 May 25 16:21:59.173873 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 114/229] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:21:58 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:00.184891 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-304f7386-cc5f-4d04-8288-a8a282082963 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:00.185502 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-304f7386-cc5f-4d04-8288-a8a282082963 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:00.199057 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-304f7386-cc5f-4d04-8288-a8a282082963 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:00.201171 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-304f7386-cc5f-4d04-8288-a8a282082963 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:00.202236 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-304f7386-cc5f-4d04-8288-a8a282082963 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:00.202929 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-304f7386-cc5f-4d04-8288-a8a282082963 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:00.459539 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-304f7386-cc5f-4d04-8288-a8a282082963 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:00.468179 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-304f7386-cc5f-4d04-8288-a8a282082963 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.287591 May 25 16:22:00.471659 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 116/230] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:00 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:01.496006 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-e9863c91-b647-48df-82c6-6bc4ccf7c6c8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:01.496658 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-e9863c91-b647-48df-82c6-6bc4ccf7c6c8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:01.512369 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e9863c91-b647-48df-82c6-6bc4ccf7c6c8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:01.513445 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e9863c91-b647-48df-82c6-6bc4ccf7c6c8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:01.515897 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e9863c91-b647-48df-82c6-6bc4ccf7c6c8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:01.516533 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e9863c91-b647-48df-82c6-6bc4ccf7c6c8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:02.331688 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-e9863c91-b647-48df-82c6-6bc4ccf7c6c8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:02.346734 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-e9863c91-b647-48df-82c6-6bc4ccf7c6c8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.859835 May 25 16:22:02.349200 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 115/231] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:01 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:03.367146 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-9e47a60b-123e-4d5a-ad3f-3b5a220666c4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:03.368378 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-9e47a60b-123e-4d5a-ad3f-3b5a220666c4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:03.377136 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9e47a60b-123e-4d5a-ad3f-3b5a220666c4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:03.377591 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9e47a60b-123e-4d5a-ad3f-3b5a220666c4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:03.378406 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9e47a60b-123e-4d5a-ad3f-3b5a220666c4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:03.398305 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9e47a60b-123e-4d5a-ad3f-3b5a220666c4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:03.606015 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-9e47a60b-123e-4d5a-ad3f-3b5a220666c4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:03.615353 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-9e47a60b-123e-4d5a-ad3f-3b5a220666c4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.253170 May 25 16:22:03.616831 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 117/232] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:03 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:04.635632 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-3158a2a9-325f-4800-9f8e-529a639a993b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:04.636492 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-3158a2a9-325f-4800-9f8e-529a639a993b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:04.646951 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3158a2a9-325f-4800-9f8e-529a639a993b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:04.647700 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3158a2a9-325f-4800-9f8e-529a639a993b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:04.648667 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3158a2a9-325f-4800-9f8e-529a639a993b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:04.651607 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3158a2a9-325f-4800-9f8e-529a639a993b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:04.908206 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-3158a2a9-325f-4800-9f8e-529a639a993b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:04.920162 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-3158a2a9-325f-4800-9f8e-529a639a993b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.291170 May 25 16:22:04.920646 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 116/233] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:04 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:22:05.145116 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-0922f646-e450-4473-b49c-44a66ca7856b tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Action: 'create', calling method: .version_select at 0x7f51edb7dd30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1857624386", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCccww+sJ7nWFQr6kzYW35R67++2aNioZL4Ug74gVNoc78HFq4crxJBSe9nypjqlZfamFarEAdyiWtmhQozJ0PSbl3NGHlQNG3KNp1ehMiObj1PfVE4Iyp5VvkeONaHPg=="}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:22:05.165194 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-0922f646-e450-4473-b49c-44a66ca7856b tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Getting quotas for project a40431f830294ea0a6395be072560dea. Resources: {'key_pairs'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:22:05.170804 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-0922f646-e450-4473-b49c-44a66ca7856b tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Getting quotas for user c935f035c757482ca912a8c4b77714a0 and project a40431f830294ea0a6395be072560dea. Resources: {'key_pairs'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:22:05.205739 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-0922f646-e450-4473-b49c-44a66ca7856b tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.299495 May 25 16:22:05.206333 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 118/234] 10.222.0.42 () {60 vars in 1158 bytes} [Wed May 25 16:22:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:22:05.938493 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-633da367-5458-4e4f-ac7c-3bfb3e150048 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:05.940514 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-633da367-5458-4e4f-ac7c-3bfb3e150048 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:05.949044 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-633da367-5458-4e4f-ac7c-3bfb3e150048 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:05.949499 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-633da367-5458-4e4f-ac7c-3bfb3e150048 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:05.950462 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-633da367-5458-4e4f-ac7c-3bfb3e150048 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:05.951898 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-633da367-5458-4e4f-ac7c-3bfb3e150048 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:06.135988 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-633da367-5458-4e4f-ac7c-3bfb3e150048 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:06.153961 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-633da367-5458-4e4f-ac7c-3bfb3e150048 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.215109 May 25 16:22:06.154478 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 117/235] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:05 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:07.179606 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-232f5764-8ff4-49a8-8acb-ca314f83d6ab tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:07.180969 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-232f5764-8ff4-49a8-8acb-ca314f83d6ab tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:07.193084 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-232f5764-8ff4-49a8-8acb-ca314f83d6ab tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:07.196219 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-232f5764-8ff4-49a8-8acb-ca314f83d6ab tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:07.197214 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-232f5764-8ff4-49a8-8acb-ca314f83d6ab tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:07.197847 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-232f5764-8ff4-49a8-8acb-ca314f83d6ab tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:07.381955 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-232f5764-8ff4-49a8-8acb-ca314f83d6ab tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:07.390851 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-232f5764-8ff4-49a8-8acb-ca314f83d6ab tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.223890 May 25 16:22:07.396498 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 119/236] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:07 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:08.410748 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-79f89876-2014-4fe3-99e7-227e8fd2cd50 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:08.412901 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-79f89876-2014-4fe3-99e7-227e8fd2cd50 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:08.419630 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-79f89876-2014-4fe3-99e7-227e8fd2cd50 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:08.420248 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-79f89876-2014-4fe3-99e7-227e8fd2cd50 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:08.421207 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-79f89876-2014-4fe3-99e7-227e8fd2cd50 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:08.421652 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-79f89876-2014-4fe3-99e7-227e8fd2cd50 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:08.595626 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-79f89876-2014-4fe3-99e7-227e8fd2cd50 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:08.604825 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-79f89876-2014-4fe3-99e7-227e8fd2cd50 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.198398 May 25 16:22:08.605956 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 118/237] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:08 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:09.622504 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-7c27241b-6a70-4f30-afcd-f7ce8306d9e9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:09.623113 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-7c27241b-6a70-4f30-afcd-f7ce8306d9e9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:09.625125 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:22:09.631091 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7c27241b-6a70-4f30-afcd-f7ce8306d9e9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:09.631550 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7c27241b-6a70-4f30-afcd-f7ce8306d9e9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:09.632320 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7c27241b-6a70-4f30-afcd-f7ce8306d9e9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:09.632754 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7c27241b-6a70-4f30-afcd-f7ce8306d9e9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:09.777833 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-7c27241b-6a70-4f30-afcd-f7ce8306d9e9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:09.785848 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-7c27241b-6a70-4f30-afcd-f7ce8306d9e9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.167558 May 25 16:22:09.786538 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 120/238] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:09 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:10.804689 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-db27a9df-0641-42b0-a8af-3d80ea632630 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:10.805281 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-db27a9df-0641-42b0-a8af-3d80ea632630 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:10.811306 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-db27a9df-0641-42b0-a8af-3d80ea632630 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:10.811748 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-db27a9df-0641-42b0-a8af-3d80ea632630 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:10.812491 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-db27a9df-0641-42b0-a8af-3d80ea632630 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:10.812920 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-db27a9df-0641-42b0-a8af-3d80ea632630 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:10.954903 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-db27a9df-0641-42b0-a8af-3d80ea632630 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:10.963823 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-db27a9df-0641-42b0-a8af-3d80ea632630 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.163735 May 25 16:22:10.964504 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 119/239] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:10 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:11.980451 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-92b2ed9a-f7fc-49cb-bfb2-557b8d7e9dc0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:11.981053 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-92b2ed9a-f7fc-49cb-bfb2-557b8d7e9dc0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:11.988023 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-92b2ed9a-f7fc-49cb-bfb2-557b8d7e9dc0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:11.988469 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-92b2ed9a-f7fc-49cb-bfb2-557b8d7e9dc0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:11.989236 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-92b2ed9a-f7fc-49cb-bfb2-557b8d7e9dc0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:11.989673 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-92b2ed9a-f7fc-49cb-bfb2-557b8d7e9dc0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:12.118744 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-92b2ed9a-f7fc-49cb-bfb2-557b8d7e9dc0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:12.126508 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-92b2ed9a-f7fc-49cb-bfb2-557b8d7e9dc0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.149880 May 25 16:22:12.129470 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 121/240] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:11 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:13.143078 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-f4c9835a-3933-43fa-901c-b3d31f8d3541 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:13.143697 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-f4c9835a-3933-43fa-901c-b3d31f8d3541 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:13.150689 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f4c9835a-3933-43fa-901c-b3d31f8d3541 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:13.151139 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f4c9835a-3933-43fa-901c-b3d31f8d3541 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:13.151910 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f4c9835a-3933-43fa-901c-b3d31f8d3541 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:13.152353 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f4c9835a-3933-43fa-901c-b3d31f8d3541 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:13.292550 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-f4c9835a-3933-43fa-901c-b3d31f8d3541 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:13.299938 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-f4c9835a-3933-43fa-901c-b3d31f8d3541 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.160796 May 25 16:22:13.300512 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 120/241] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:13 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:14.316655 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-18ffa3b7-0b53-437a-bdf9-62df0b43cd6a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:14.317258 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-18ffa3b7-0b53-437a-bdf9-62df0b43cd6a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:14.324610 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-18ffa3b7-0b53-437a-bdf9-62df0b43cd6a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:14.325055 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-18ffa3b7-0b53-437a-bdf9-62df0b43cd6a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:14.325860 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-18ffa3b7-0b53-437a-bdf9-62df0b43cd6a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:14.326308 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-18ffa3b7-0b53-437a-bdf9-62df0b43cd6a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:14.329010 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=89 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:22:14.460449 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-18ffa3b7-0b53-437a-bdf9-62df0b43cd6a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:14.468958 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-18ffa3b7-0b53-437a-bdf9-62df0b43cd6a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.156211 May 25 16:22:14.469821 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 122/242] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:14 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:15.486467 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-703c7a2a-51db-46b1-b593-5fbd2ab0bd07 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:15.487076 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-703c7a2a-51db-46b1-b593-5fbd2ab0bd07 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:15.493878 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-703c7a2a-51db-46b1-b593-5fbd2ab0bd07 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:15.494444 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-703c7a2a-51db-46b1-b593-5fbd2ab0bd07 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:15.495281 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-703c7a2a-51db-46b1-b593-5fbd2ab0bd07 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:15.495791 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-703c7a2a-51db-46b1-b593-5fbd2ab0bd07 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:15.641014 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-703c7a2a-51db-46b1-b593-5fbd2ab0bd07 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:15.649599 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-703c7a2a-51db-46b1-b593-5fbd2ab0bd07 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.166758 May 25 16:22:15.650216 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 121/243] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:15 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:16.666115 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-70158ad4-6514-4c5f-a93c-1c961490bbc5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:16.666630 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-70158ad4-6514-4c5f-a93c-1c961490bbc5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:16.668452 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell0:SELECT=4 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:22:16.674176 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-70158ad4-6514-4c5f-a93c-1c961490bbc5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:16.674633 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-70158ad4-6514-4c5f-a93c-1c961490bbc5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:16.675398 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-70158ad4-6514-4c5f-a93c-1c961490bbc5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:16.675838 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-70158ad4-6514-4c5f-a93c-1c961490bbc5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:16.819574 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-70158ad4-6514-4c5f-a93c-1c961490bbc5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:16.827260 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-70158ad4-6514-4c5f-a93c-1c961490bbc5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1520 microversion: 2.1 time: 0.165306 May 25 16:22:16.827840 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 123/244] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:16 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:17.843795 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-3df031f2-9e5f-49e8-80e9-ee667ee5f659 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:17.844397 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-3df031f2-9e5f-49e8-80e9-ee667ee5f659 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:17.850558 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3df031f2-9e5f-49e8-80e9-ee667ee5f659 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:17.851009 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3df031f2-9e5f-49e8-80e9-ee667ee5f659 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:17.851759 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3df031f2-9e5f-49e8-80e9-ee667ee5f659 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:17.852194 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3df031f2-9e5f-49e8-80e9-ee667ee5f659 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:17.989696 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-3df031f2-9e5f-49e8-80e9-ee667ee5f659 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:17.997614 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-3df031f2-9e5f-49e8-80e9-ee667ee5f659 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1500 microversion: 2.1 time: 0.157563 May 25 16:22:17.998226 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 122/245] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:17 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1500 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:18.014730 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-5aa9a272-0b37-4e14-b476-e80ce8447358 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:18.015346 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-5aa9a272-0b37-4e14-b476-e80ce8447358 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:18.022396 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5aa9a272-0b37-4e14-b476-e80ce8447358 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:18.022855 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5aa9a272-0b37-4e14-b476-e80ce8447358 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:18.023620 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5aa9a272-0b37-4e14-b476-e80ce8447358 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:18.024058 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5aa9a272-0b37-4e14-b476-e80ce8447358 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:18.164648 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-5aa9a272-0b37-4e14-b476-e80ce8447358 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:18.172431 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-5aa9a272-0b37-4e14-b476-e80ce8447358 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1514 microversion: 2.1 time: 0.161636 May 25 16:22:18.173016 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 124/246] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:18 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:22:19.553464 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-98679fc7-38a7-46d0-9f65-fd0b6bd68d4f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:22:19.554589 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-98679fc7-38a7-46d0-9f65-fd0b6bd68d4f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:19.556766 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_api:SELECT=25 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:22:19.562240 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-98679fc7-38a7-46d0-9f65-fd0b6bd68d4f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:19.562880 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-98679fc7-38a7-46d0-9f65-fd0b6bd68d4f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:19.563701 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-98679fc7-38a7-46d0-9f65-fd0b6bd68d4f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:19.564238 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-98679fc7-38a7-46d0-9f65-fd0b6bd68d4f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:19.569296 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=73 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:22:19.591173 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.objects.instance [None req-98679fc7-38a7-46d0-9f65-fd0b6bd68d4f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lazy-loading 'flavor' on Instance uuid 68f324c4-3a3e-4e8d-b2ca-91493fae47b1 {{(pid=117509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:22:19.667750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-98679fc7-38a7-46d0-9f65-fd0b6bd68d4f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "POST /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1/action" status: 200 len: 32 microversion: 2.1 time: 0.118542 May 25 16:22:19.668469 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 123/247] 10.222.0.42 () {60 vars in 1277 bytes} [Wed May 25 16:22:19 2022] POST /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1/action => generated 32 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 16:22:19.679021 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-298efc58-9b3b-4126-9568-1804a8fd44bd tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:19.679630 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-298efc58-9b3b-4126-9568-1804a8fd44bd tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:19.686634 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-298efc58-9b3b-4126-9568-1804a8fd44bd tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:19.687190 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-298efc58-9b3b-4126-9568-1804a8fd44bd tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:19.688407 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-298efc58-9b3b-4126-9568-1804a8fd44bd tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:19.689023 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-298efc58-9b3b-4126-9568-1804a8fd44bd tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:19.908194 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-298efc58-9b3b-4126-9568-1804a8fd44bd tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:19.916709 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-298efc58-9b3b-4126-9568-1804a8fd44bd tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1520 microversion: 2.1 time: 0.243123 May 25 16:22:19.917337 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 125/248] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:19 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:22:20.934238 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-d8d422c7-efb6-4d0c-8ad2-a0912842d627 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:20.934943 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-d8d422c7-efb6-4d0c-8ad2-a0912842d627 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:20.941680 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d8d422c7-efb6-4d0c-8ad2-a0912842d627 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:20.942164 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d8d422c7-efb6-4d0c-8ad2-a0912842d627 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:20.943587 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d8d422c7-efb6-4d0c-8ad2-a0912842d627 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:20.944116 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d8d422c7-efb6-4d0c-8ad2-a0912842d627 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:21.082131 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-d8d422c7-efb6-4d0c-8ad2-a0912842d627 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:21.090579 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-d8d422c7-efb6-4d0c-8ad2-a0912842d627 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1520 microversion: 2.1 time: 0.160614 May 25 16:22:21.091147 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 124/249] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:20 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:22.107755 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-46fc7e17-1e45-4851-a865-cdf4ce279bd3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:22.108392 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-46fc7e17-1e45-4851-a865-cdf4ce279bd3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:22.115026 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-46fc7e17-1e45-4851-a865-cdf4ce279bd3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:22.115491 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-46fc7e17-1e45-4851-a865-cdf4ce279bd3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:22.116327 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-46fc7e17-1e45-4851-a865-cdf4ce279bd3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:22.116749 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-46fc7e17-1e45-4851-a865-cdf4ce279bd3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:22.252824 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-46fc7e17-1e45-4851-a865-cdf4ce279bd3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:22.261457 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-46fc7e17-1e45-4851-a865-cdf4ce279bd3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1520 microversion: 2.1 time: 0.157478 May 25 16:22:22.262424 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 126/250] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:22 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:23.279103 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-8fffc208-9004-4033-b5a6-84048ca72a83 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:23.279714 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-8fffc208-9004-4033-b5a6-84048ca72a83 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:23.286981 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8fffc208-9004-4033-b5a6-84048ca72a83 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:23.287944 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8fffc208-9004-4033-b5a6-84048ca72a83 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:23.289146 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8fffc208-9004-4033-b5a6-84048ca72a83 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:23.289772 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8fffc208-9004-4033-b5a6-84048ca72a83 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:23.429619 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-8fffc208-9004-4033-b5a6-84048ca72a83 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:23.443441 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-8fffc208-9004-4033-b5a6-84048ca72a83 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1520 microversion: 2.1 time: 0.167313 May 25 16:22:23.444287 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 125/251] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:23 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:24.460912 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-272390cf-9097-4c06-93e6-cd44f0d9642a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:24.461537 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-272390cf-9097-4c06-93e6-cd44f0d9642a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:24.468078 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-272390cf-9097-4c06-93e6-cd44f0d9642a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:24.468520 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-272390cf-9097-4c06-93e6-cd44f0d9642a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:24.469272 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-272390cf-9097-4c06-93e6-cd44f0d9642a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:24.469708 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-272390cf-9097-4c06-93e6-cd44f0d9642a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:24.607593 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-272390cf-9097-4c06-93e6-cd44f0d9642a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:24.615472 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-272390cf-9097-4c06-93e6-cd44f0d9642a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1520 microversion: 2.1 time: 0.158986 May 25 16:22:24.616305 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 127/252] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:24 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:25.631797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-c14a32cc-a895-4fd0-9737-ff4c389dc43a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:25.632394 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-c14a32cc-a895-4fd0-9737-ff4c389dc43a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:25.638458 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c14a32cc-a895-4fd0-9737-ff4c389dc43a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:25.638907 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c14a32cc-a895-4fd0-9737-ff4c389dc43a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:25.639682 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c14a32cc-a895-4fd0-9737-ff4c389dc43a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:25.640098 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c14a32cc-a895-4fd0-9737-ff4c389dc43a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:25.772664 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-c14a32cc-a895-4fd0-9737-ff4c389dc43a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:25.783923 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-c14a32cc-a895-4fd0-9737-ff4c389dc43a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1520 microversion: 2.1 time: 0.156126 May 25 16:22:25.784524 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 126/253] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:25 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:26.803892 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-da27f0ae-2fb7-4c6e-bedb-cdfd69ed511f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:26.805629 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-da27f0ae-2fb7-4c6e-bedb-cdfd69ed511f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:26.814465 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-da27f0ae-2fb7-4c6e-bedb-cdfd69ed511f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:26.815073 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-da27f0ae-2fb7-4c6e-bedb-cdfd69ed511f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:26.816368 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-da27f0ae-2fb7-4c6e-bedb-cdfd69ed511f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:26.816820 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-da27f0ae-2fb7-4c6e-bedb-cdfd69ed511f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:26.957779 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-da27f0ae-2fb7-4c6e-bedb-cdfd69ed511f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:26.965791 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-da27f0ae-2fb7-4c6e-bedb-cdfd69ed511f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1520 microversion: 2.1 time: 0.167259 May 25 16:22:26.966355 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 128/254] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:26 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:27.902451 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-4f89e456-1c1c-437b-a2ee-b9e97c482642 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:27.902974 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-4f89e456-1c1c-437b-a2ee-b9e97c482642 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:27.908910 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4f89e456-1c1c-437b-a2ee-b9e97c482642 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:27.909358 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4f89e456-1c1c-437b-a2ee-b9e97c482642 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:27.910161 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4f89e456-1c1c-437b-a2ee-b9e97c482642 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:27.910599 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4f89e456-1c1c-437b-a2ee-b9e97c482642 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:27.934555 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-4f89e456-1c1c-437b-a2ee-b9e97c482642 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98/ips" status: 200 len: 150 microversion: 2.1 time: 0.035959 May 25 16:22:27.935135 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 127/255] 10.222.0.42 () {58 vars in 1247 bytes} [Wed May 25 16:22:27 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:22:27.992532 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-44c59c21-fc5d-47ca-a5bd-afd69da293f8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:27.993440 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-44c59c21-fc5d-47ca-a5bd-afd69da293f8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:28.000529 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-44c59c21-fc5d-47ca-a5bd-afd69da293f8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:28.000987 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-44c59c21-fc5d-47ca-a5bd-afd69da293f8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:28.001793 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-44c59c21-fc5d-47ca-a5bd-afd69da293f8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:28.002230 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-44c59c21-fc5d-47ca-a5bd-afd69da293f8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:28.155840 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-44c59c21-fc5d-47ca-a5bd-afd69da293f8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:28.163854 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-44c59c21-fc5d-47ca-a5bd-afd69da293f8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1520 microversion: 2.1 time: 0.175906 May 25 16:22:28.164423 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 129/256] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:27 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:29.180611 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-583959e4-7205-4719-8388-f1a0ffaa3491 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:29.181374 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-583959e4-7205-4719-8388-f1a0ffaa3491 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:29.187527 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-583959e4-7205-4719-8388-f1a0ffaa3491 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:29.187982 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-583959e4-7205-4719-8388-f1a0ffaa3491 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:29.188765 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-583959e4-7205-4719-8388-f1a0ffaa3491 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:29.189216 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-583959e4-7205-4719-8388-f1a0ffaa3491 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:29.341671 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-583959e4-7205-4719-8388-f1a0ffaa3491 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:29.342126 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-763b819a-ba85-47be-9dc9-f4e53025004a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d1b758c-ccc9-47a3-ab27-c3eddd5bc169"}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:22:29.343806 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-763b819a-ba85-47be-9dc9-f4e53025004a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:29.350489 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-583959e4-7205-4719-8388-f1a0ffaa3491 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1520 microversion: 2.1 time: 0.173712 May 25 16:22:29.350993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-763b819a-ba85-47be-9dc9-f4e53025004a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:29.351468 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 128/257] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:29 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:29.360164 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-763b819a-ba85-47be-9dc9-f4e53025004a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:29.361047 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-763b819a-ba85-47be-9dc9-f4e53025004a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:29.361685 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-763b819a-ba85-47be-9dc9-f4e53025004a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:29.649524 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-763b819a-ba85-47be-9dc9-f4e53025004a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "POST /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312341 May 25 16:22:29.650202 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 130/258] 10.222.0.42 () {60 vars in 1322 bytes} [Wed May 25 16:22:29 2022] POST /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:22:30.368085 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-1ea83d88-461d-4c51-a214-c03f1d4f4895 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:30.368690 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-1ea83d88-461d-4c51-a214-c03f1d4f4895 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:30.374886 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1ea83d88-461d-4c51-a214-c03f1d4f4895 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:30.375338 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1ea83d88-461d-4c51-a214-c03f1d4f4895 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:30.376098 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1ea83d88-461d-4c51-a214-c03f1d4f4895 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:30.376536 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1ea83d88-461d-4c51-a214-c03f1d4f4895 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:30.503387 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-1ea83d88-461d-4c51-a214-c03f1d4f4895 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:30.511852 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-1ea83d88-461d-4c51-a214-c03f1d4f4895 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1520 microversion: 2.1 time: 0.148110 May 25 16:22:30.512423 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 129/259] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:30 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:31.529951 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-d6b97885-9cb9-492b-bc1e-64c043c34eee tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:31.530671 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-d6b97885-9cb9-492b-bc1e-64c043c34eee tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:31.536798 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d6b97885-9cb9-492b-bc1e-64c043c34eee tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:31.537242 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d6b97885-9cb9-492b-bc1e-64c043c34eee tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:31.538562 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d6b97885-9cb9-492b-bc1e-64c043c34eee tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:31.539004 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d6b97885-9cb9-492b-bc1e-64c043c34eee tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:31.669412 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-d6b97885-9cb9-492b-bc1e-64c043c34eee tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:31.676786 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-d6b97885-9cb9-492b-bc1e-64c043c34eee tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1520 microversion: 2.1 time: 0.151460 May 25 16:22:31.677378 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 131/260] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:31 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:32.693958 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-967e3a2b-7dd6-44ec-af7c-2a9d42374496 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:32.695146 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-967e3a2b-7dd6-44ec-af7c-2a9d42374496 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:32.701923 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-967e3a2b-7dd6-44ec-af7c-2a9d42374496 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:32.702661 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-967e3a2b-7dd6-44ec-af7c-2a9d42374496 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:32.703651 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-967e3a2b-7dd6-44ec-af7c-2a9d42374496 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:32.704295 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-967e3a2b-7dd6-44ec-af7c-2a9d42374496 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:32.843476 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-967e3a2b-7dd6-44ec-af7c-2a9d42374496 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:32.852321 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-967e3a2b-7dd6-44ec-af7c-2a9d42374496 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1520 microversion: 2.1 time: 0.162039 May 25 16:22:32.852998 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 130/261] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:32 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:33.870186 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-fcf1b468-4536-4071-859b-4a705c314ad4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:33.870710 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-fcf1b468-4536-4071-859b-4a705c314ad4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:33.877171 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-fcf1b468-4536-4071-859b-4a705c314ad4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:33.877619 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-fcf1b468-4536-4071-859b-4a705c314ad4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:33.878400 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-fcf1b468-4536-4071-859b-4a705c314ad4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:33.878837 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-fcf1b468-4536-4071-859b-4a705c314ad4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:34.004010 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-fcf1b468-4536-4071-859b-4a705c314ad4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:34.012124 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-fcf1b468-4536-4071-859b-4a705c314ad4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1520 microversion: 2.1 time: 0.146445 May 25 16:22:34.012715 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 132/262] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:33 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:35.028531 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-0cacf410-48f7-4c86-a43e-2bced5ced24c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:35.029137 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-0cacf410-48f7-4c86-a43e-2bced5ced24c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:35.035223 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0cacf410-48f7-4c86-a43e-2bced5ced24c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:35.035673 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0cacf410-48f7-4c86-a43e-2bced5ced24c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:35.036426 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0cacf410-48f7-4c86-a43e-2bced5ced24c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:35.036862 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0cacf410-48f7-4c86-a43e-2bced5ced24c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:35.166657 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-0cacf410-48f7-4c86-a43e-2bced5ced24c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:35.174016 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-0cacf410-48f7-4c86-a43e-2bced5ced24c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1520 microversion: 2.1 time: 0.149317 May 25 16:22:35.174575 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 131/263] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:35 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:36.191412 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-04b6a9d7-56fc-4ad8-8fed-323b16c73cb2 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:36.192021 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-04b6a9d7-56fc-4ad8-8fed-323b16c73cb2 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:36.198718 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-04b6a9d7-56fc-4ad8-8fed-323b16c73cb2 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:36.199168 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-04b6a9d7-56fc-4ad8-8fed-323b16c73cb2 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:36.199932 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-04b6a9d7-56fc-4ad8-8fed-323b16c73cb2 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:36.200370 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-04b6a9d7-56fc-4ad8-8fed-323b16c73cb2 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:36.327438 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-04b6a9d7-56fc-4ad8-8fed-323b16c73cb2 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:36.335409 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-04b6a9d7-56fc-4ad8-8fed-323b16c73cb2 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1520 microversion: 2.1 time: 0.147337 May 25 16:22:36.335964 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 133/264] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:36 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:37.352198 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-aacc03bb-6b6d-4c98-8fe6-73f86bc9a2cb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:37.352821 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-aacc03bb-6b6d-4c98-8fe6-73f86bc9a2cb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:37.358909 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-aacc03bb-6b6d-4c98-8fe6-73f86bc9a2cb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:37.359397 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-aacc03bb-6b6d-4c98-8fe6-73f86bc9a2cb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:37.360161 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-aacc03bb-6b6d-4c98-8fe6-73f86bc9a2cb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:37.360594 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-aacc03bb-6b6d-4c98-8fe6-73f86bc9a2cb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:37.510711 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-aacc03bb-6b6d-4c98-8fe6-73f86bc9a2cb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:37.518532 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-aacc03bb-6b6d-4c98-8fe6-73f86bc9a2cb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1520 microversion: 2.1 time: 0.170305 May 25 16:22:37.519209 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 132/265] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:37 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:38.536535 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-38f37890-2011-4050-be23-856a80499695 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:38.536993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-38f37890-2011-4050-be23-856a80499695 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:38.545217 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-38f37890-2011-4050-be23-856a80499695 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:38.545695 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-38f37890-2011-4050-be23-856a80499695 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:38.546452 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-38f37890-2011-4050-be23-856a80499695 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:38.546883 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-38f37890-2011-4050-be23-856a80499695 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:38.673460 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-deda0579-a5d3-474e-9707-76966eb52f38 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1749702831", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1857624386", "security_groups": [{"name": "tempest-secgroup-smoke-1860376157"}], "block_device_mapping_v2": [{"uuid": "0343a3ee-5c04-4a99-9c60-ed1f3cb80073", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5f7c259b-fa42-4f62-9149-4145e768ec9c"}]}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:22:38.689473 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-38f37890-2011-4050-be23-856a80499695 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:38.697736 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-38f37890-2011-4050-be23-856a80499695 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1520 microversion: 2.1 time: 0.165277 May 25 16:22:38.698352 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 134/266] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:38 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:38.788266 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.network.neutron [None req-deda0579-a5d3-474e-9707-76966eb52f38 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] validate_networks() for [('5f7c259b-fa42-4f62-9149-4145e768ec9c', None, None, None, None, None)] {{(pid=117509) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:22:39.158267 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-deda0579-a5d3-474e-9707-76966eb52f38 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Flavor limits 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:22:39.158686 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-deda0579-a5d3-474e-9707-76966eb52f38 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Image limits 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:22:39.159152 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-deda0579-a5d3-474e-9707-76966eb52f38 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Flavor pref 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:22:39.159550 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-deda0579-a5d3-474e-9707-76966eb52f38 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Image pref 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:22:39.160167 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-deda0579-a5d3-474e-9707-76966eb52f38 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:22:39.170586 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-deda0579-a5d3-474e-9707-76966eb52f38 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:39.171034 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-deda0579-a5d3-474e-9707-76966eb52f38 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:39.171828 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-deda0579-a5d3-474e-9707-76966eb52f38 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:39.172265 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-deda0579-a5d3-474e-9707-76966eb52f38 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:39.201162 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-deda0579-a5d3-474e-9707-76966eb52f38 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Getting quotas for project a40431f830294ea0a6395be072560dea. Resources: {'ram', 'cores', 'instances'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:22:39.205189 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-deda0579-a5d3-474e-9707-76966eb52f38 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Getting quotas for user c935f035c757482ca912a8c4b77714a0 and project a40431f830294ea0a6395be072560dea. Resources: {'ram', 'cores', 'instances'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:22:39.278680 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-5f854f9c-4058-4a4d-87d8-710aaba5a4aa tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Action: 'create', calling method: .version_select at 0x7f51eda79280>, body: {"keypair": {"name": "tempest-keypair-1795382636", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYe9y1mdkaNqpimp2GFc29Of0Ad0nnv8CQdS5zY4oBJVMxY1IxyMCeySTqkoUnt4enw4dZdx7vwkc4wKS7bGDvaAwvGxgd8RJ2X1Lh8ypbE8rNN6dwMpiGu6vVkICClPg=="}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:22:39.294251 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-5f854f9c-4058-4a4d-87d8-710aaba5a4aa tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Getting quotas for project 9d234edace28441282f594f0e03cacc5. Resources: {'key_pairs'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:22:39.298768 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-5f854f9c-4058-4a4d-87d8-710aaba5a4aa tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Getting quotas for user b781c4c6cb61439fb781988a7da028ff and project 9d234edace28441282f594f0e03cacc5. Resources: {'key_pairs'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:22:39.316212 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-deda0579-a5d3-474e-9707-76966eb52f38 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Going to run 1 instances... {{(pid=117509) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:22:39.318818 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-deda0579-a5d3-474e-9707-76966eb52f38 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0343a3ee-5c04-4a99-9c60-ed1f3cb80073',volume_size=None,volume_type=None)] {{(pid=117509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:22:39.323543 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-5f854f9c-4058-4a4d-87d8-710aaba5a4aa tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049213 May 25 16:22:39.325200 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 135/267] 10.222.0.42 () {60 vars in 1158 bytes} [Wed May 25 16:22:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:22:39.464261 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-deda0579-a5d3-474e-9707-76966eb52f38 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.794470 May 25 16:22:39.465107 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 133/268] 10.222.0.42 () {60 vars in 1146 bytes} [Wed May 25 16:22:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:22:39.475926 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-4989401c-2dee-4af2-99e2-52472ba799f3 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:39.477178 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-4989401c-2dee-4af2-99e2-52472ba799f3 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:39.556952 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-4989401c-2dee-4af2-99e2-52472ba799f3 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:39.566561 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-4989401c-2dee-4af2-99e2-52472ba799f3 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760" status: 200 len: 1095 microversion: 2.1 time: 0.094906 May 25 16:22:39.569776 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 136/269] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:39 2022] GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 => generated 1095 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:39.715800 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-286b4cd0-c2df-4be5-b7ea-a29198eeb034 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:39.716940 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-286b4cd0-c2df-4be5-b7ea-a29198eeb034 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:39.723345 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-286b4cd0-c2df-4be5-b7ea-a29198eeb034 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:39.723941 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-286b4cd0-c2df-4be5-b7ea-a29198eeb034 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:39.724647 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-286b4cd0-c2df-4be5-b7ea-a29198eeb034 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:39.725167 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-286b4cd0-c2df-4be5-b7ea-a29198eeb034 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:39.878343 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-286b4cd0-c2df-4be5-b7ea-a29198eeb034 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:39.887417 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-286b4cd0-c2df-4be5-b7ea-a29198eeb034 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1520 microversion: 2.1 time: 0.175671 May 25 16:22:39.888045 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 134/270] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:39 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:40.175002 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-7260f312-0f5b-46c3-8401-4bbea87ed539 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:40.175711 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-7260f312-0f5b-46c3-8401-4bbea87ed539 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:40.177972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:22:40.194805 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7260f312-0f5b-46c3-8401-4bbea87ed539 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:40.195821 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7260f312-0f5b-46c3-8401-4bbea87ed539 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:40.196859 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7260f312-0f5b-46c3-8401-4bbea87ed539 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:40.197587 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7260f312-0f5b-46c3-8401-4bbea87ed539 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:40.229627 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-7260f312-0f5b-46c3-8401-4bbea87ed539 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef/ips" status: 200 len: 152 microversion: 2.20 time: 0.058695 May 25 16:22:40.231040 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 137/271] 10.222.0.42 () {60 vars in 1288 bytes} [Wed May 25 16:22:40 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef/ips => generated 152 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:22:40.584976 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-16d8b33e-8968-42e8-bfc1-43755ee6467b tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:40.586104 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-16d8b33e-8968-42e8-bfc1-43755ee6467b tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:40.605863 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-16d8b33e-8968-42e8-bfc1-43755ee6467b tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:40.610182 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-16d8b33e-8968-42e8-bfc1-43755ee6467b tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:40.610703 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-16d8b33e-8968-42e8-bfc1-43755ee6467b tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:40.621471 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-16d8b33e-8968-42e8-bfc1-43755ee6467b tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:40.701572 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-16d8b33e-8968-42e8-bfc1-43755ee6467b tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:40.709472 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-16d8b33e-8968-42e8-bfc1-43755ee6467b tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760" status: 200 len: 1193 microversion: 2.1 time: 0.128918 May 25 16:22:40.710387 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 135/272] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:40 2022] GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 => generated 1193 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:40.905142 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-170273e0-dc7a-492b-975c-755d517ceb83 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:40.905776 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-170273e0-dc7a-492b-975c-755d517ceb83 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:40.912614 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-170273e0-dc7a-492b-975c-755d517ceb83 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:40.913075 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-170273e0-dc7a-492b-975c-755d517ceb83 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:40.914496 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-170273e0-dc7a-492b-975c-755d517ceb83 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:40.914938 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-170273e0-dc7a-492b-975c-755d517ceb83 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:41.057117 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-170273e0-dc7a-492b-975c-755d517ceb83 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:41.063667 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-d4ba9f12-cc43-4f43-9b3a-cfa107e5c26b tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-787615917", "imageRef": "e74cccc1-cd1b-4dfc-8e47-3e4a832649a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "924a9156-87e8-4a10-ac35-4ba66726a4f5"}], "security_groups": [{"name": "tempest-securitygroup--1836516643"}], "key_name": "tempest-keypair-1795382636", "user_data": "}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:22:41.065144 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-170273e0-dc7a-492b-975c-755d517ceb83 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1520 microversion: 2.1 time: 0.163935 May 25 16:22:41.065728 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 138/273] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:40 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:41.172472 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.network.neutron [None req-d4ba9f12-cc43-4f43-9b3a-cfa107e5c26b tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] validate_networks() for [('924a9156-87e8-4a10-ac35-4ba66726a4f5', None, None, None, None, None)] {{(pid=117509) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:22:41.626450 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-2a3ec386-51a0-41a6-a896-e10d652f17fd tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:41.627105 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-2a3ec386-51a0-41a6-a896-e10d652f17fd tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:41.634483 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2a3ec386-51a0-41a6-a896-e10d652f17fd tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:41.635326 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2a3ec386-51a0-41a6-a896-e10d652f17fd tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:41.636435 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2a3ec386-51a0-41a6-a896-e10d652f17fd tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:41.637015 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2a3ec386-51a0-41a6-a896-e10d652f17fd tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:41.668312 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-2a3ec386-51a0-41a6-a896-e10d652f17fd tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f/ips" status: 200 len: 145 microversion: 2.1 time: 0.048454 May 25 16:22:41.681471 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 139/274] 10.222.0.42 () {58 vars in 1247 bytes} [Wed May 25 16:22:41 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f/ips => generated 145 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:22:41.689034 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-d4ba9f12-cc43-4f43-9b3a-cfa107e5c26b tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Flavor limits 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:22:41.689546 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-d4ba9f12-cc43-4f43-9b3a-cfa107e5c26b tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Image limits 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:22:41.690147 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-d4ba9f12-cc43-4f43-9b3a-cfa107e5c26b tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Flavor pref 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:22:41.690613 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-d4ba9f12-cc43-4f43-9b3a-cfa107e5c26b tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Image pref 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:22:41.691083 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-d4ba9f12-cc43-4f43-9b3a-cfa107e5c26b tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:22:41.700693 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d4ba9f12-cc43-4f43-9b3a-cfa107e5c26b tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:41.701131 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d4ba9f12-cc43-4f43-9b3a-cfa107e5c26b tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:41.701948 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d4ba9f12-cc43-4f43-9b3a-cfa107e5c26b tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:41.702383 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d4ba9f12-cc43-4f43-9b3a-cfa107e5c26b tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:41.718731 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-d4ba9f12-cc43-4f43-9b3a-cfa107e5c26b tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Getting quotas for project 9d234edace28441282f594f0e03cacc5. Resources: {'ram', 'cores', 'instances'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:22:41.722413 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-d4ba9f12-cc43-4f43-9b3a-cfa107e5c26b tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Getting quotas for user b781c4c6cb61439fb781988a7da028ff and project 9d234edace28441282f594f0e03cacc5. Resources: {'ram', 'cores', 'instances'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:22:41.728676 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-4da54fd1-d6ba-4cb2-8ee7-f2ff496f920f tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:41.729407 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-4da54fd1-d6ba-4cb2-8ee7-f2ff496f920f tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:41.734514 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-d4ba9f12-cc43-4f43-9b3a-cfa107e5c26b tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Going to run 1 instances... {{(pid=117509) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:22:41.735682 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4da54fd1-d6ba-4cb2-8ee7-f2ff496f920f tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:41.736140 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4da54fd1-d6ba-4cb2-8ee7-f2ff496f920f tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:41.736741 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-d4ba9f12-cc43-4f43-9b3a-cfa107e5c26b tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 867f3a7b-7e7e-468a-b1a3-9c71cc196f23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e74cccc1-cd1b-4dfc-8e47-3e4a832649a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:22:41.737027 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4da54fd1-d6ba-4cb2-8ee7-f2ff496f920f tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:41.737467 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4da54fd1-d6ba-4cb2-8ee7-f2ff496f920f tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:41.742594 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:22:41.784452 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-d4ba9f12-cc43-4f43-9b3a-cfa107e5c26b tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.725218 May 25 16:22:41.785381 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 136/275] 10.222.0.42 () {60 vars in 1146 bytes} [Wed May 25 16:22:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 25 16:22:41.796844 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-3d6cd965-1f27-41bb-b1a7-0832e1eaa3be tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:41.797692 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-3d6cd965-1f27-41bb-b1a7-0832e1eaa3be tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 867f3a7b-7e7e-468a-b1a3-9c71cc196f23] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:41.820953 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-4da54fd1-d6ba-4cb2-8ee7-f2ff496f920f tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:41.825995 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-4da54fd1-d6ba-4cb2-8ee7-f2ff496f920f tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760" status: 200 len: 1211 microversion: 2.1 time: 0.101539 May 25 16:22:41.826570 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 140/276] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:41 2022] GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 => generated 1211 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:22:41.874012 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-3d6cd965-1f27-41bb-b1a7-0832e1eaa3be tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:41.881263 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-3d6cd965-1f27-41bb-b1a7-0832e1eaa3be tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23" status: 200 len: 1241 microversion: 2.1 time: 0.088311 May 25 16:22:41.881878 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 137/277] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:41 2022] GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23 => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:42.082210 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-9b2eda38-4309-4218-b03d-622907bbc84e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:42.082857 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-9b2eda38-4309-4218-b03d-622907bbc84e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:42.090896 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9b2eda38-4309-4218-b03d-622907bbc84e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:42.091310 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9b2eda38-4309-4218-b03d-622907bbc84e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:42.092395 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9b2eda38-4309-4218-b03d-622907bbc84e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:42.093154 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9b2eda38-4309-4218-b03d-622907bbc84e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:42.458237 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-9b2eda38-4309-4218-b03d-622907bbc84e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:42.466195 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-9b2eda38-4309-4218-b03d-622907bbc84e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1520 microversion: 2.1 time: 0.388286 May 25 16:22:42.466749 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 141/278] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:42 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1520 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:42.675336 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-a10ff1db-5a95-4f95-a075-ae2bee198627 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:22:42.676494 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-a10ff1db-5a95-4f95-a075-ae2bee198627 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:42.685423 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a10ff1db-5a95-4f95-a075-ae2bee198627 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:42.685953 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a10ff1db-5a95-4f95-a075-ae2bee198627 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:42.686924 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a10ff1db-5a95-4f95-a075-ae2bee198627 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:42.687347 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a10ff1db-5a95-4f95-a075-ae2bee198627 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:42.714641 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.objects.instance [None req-a10ff1db-5a95-4f95-a075-ae2bee198627 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lazy-loading 'flavor' on Instance uuid d3da72ce-f083-455e-ae40-9530c53126ef {{(pid=117509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:22:42.789063 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:22:42.843723 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-3e96ba1e-9ff3-4846-bf0f-d12cdae4e2d4 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:42.844679 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-3e96ba1e-9ff3-4846-bf0f-d12cdae4e2d4 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:42.851792 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3e96ba1e-9ff3-4846-bf0f-d12cdae4e2d4 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:42.852480 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3e96ba1e-9ff3-4846-bf0f-d12cdae4e2d4 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:42.853627 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3e96ba1e-9ff3-4846-bf0f-d12cdae4e2d4 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:42.854403 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3e96ba1e-9ff3-4846-bf0f-d12cdae4e2d4 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:42.958626 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-3e96ba1e-9ff3-4846-bf0f-d12cdae4e2d4 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:42.967572 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-3e96ba1e-9ff3-4846-bf0f-d12cdae4e2d4 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760" status: 200 len: 1199 microversion: 2.1 time: 0.128404 May 25 16:22:42.968415 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 142/279] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:42 2022] GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 => generated 1199 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:42.973472 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-8be57900-f853-4da6-8322-55042ba57bfb tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:42.974176 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-8be57900-f853-4da6-8322-55042ba57bfb tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 867f3a7b-7e7e-468a-b1a3-9c71cc196f23] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:42.995825 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8be57900-f853-4da6-8322-55042ba57bfb tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:42.996811 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8be57900-f853-4da6-8322-55042ba57bfb tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:42.999022 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8be57900-f853-4da6-8322-55042ba57bfb tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:43.001055 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8be57900-f853-4da6-8322-55042ba57bfb tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:43.012697 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-a10ff1db-5a95-4f95-a075-ae2bee198627 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "POST /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef/action" status: 202 len: 0 microversion: 2.20 time: 0.341528 May 25 16:22:43.013332 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 138/280] 10.222.0.42 () {62 vars in 1318 bytes} [Wed May 25 16:22:42 2022] POST /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 16:22:43.022323 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-363d2202-1812-4120-b646-d01416e53a9d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:43.023305 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-363d2202-1812-4120-b646-d01416e53a9d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:43.030743 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-363d2202-1812-4120-b646-d01416e53a9d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:43.031265 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-363d2202-1812-4120-b646-d01416e53a9d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:43.032105 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-363d2202-1812-4120-b646-d01416e53a9d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:43.032614 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-363d2202-1812-4120-b646-d01416e53a9d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:43.088656 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-8be57900-f853-4da6-8322-55042ba57bfb tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:43.097431 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-8be57900-f853-4da6-8322-55042ba57bfb tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23" status: 200 len: 1293 microversion: 2.1 time: 0.127445 May 25 16:22:43.098590 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 143/281] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:42 2022] GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23 => generated 1293 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:43.277809 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-363d2202-1812-4120-b646-d01416e53a9d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:43.288254 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-363d2202-1812-4120-b646-d01416e53a9d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:43.292942 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-363d2202-1812-4120-b646-d01416e53a9d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:43.294931 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-363d2202-1812-4120-b646-d01416e53a9d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1722 microversion: 2.20 time: 0.277008 May 25 16:22:43.310330 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 139/282] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:22:43 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1722 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:22:43.484926 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-c559f596-e2ff-4689-a73b-fc9005e3a040 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:43.486956 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-c559f596-e2ff-4689-a73b-fc9005e3a040 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:43.501269 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c559f596-e2ff-4689-a73b-fc9005e3a040 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:43.505662 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c559f596-e2ff-4689-a73b-fc9005e3a040 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:43.506703 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c559f596-e2ff-4689-a73b-fc9005e3a040 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:43.508638 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c559f596-e2ff-4689-a73b-fc9005e3a040 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:43.867534 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-c559f596-e2ff-4689-a73b-fc9005e3a040 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:43.875886 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-c559f596-e2ff-4689-a73b-fc9005e3a040 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1500 microversion: 2.1 time: 0.396507 May 25 16:22:43.876459 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 144/283] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:43 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1500 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:43.892655 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-20eb1ba2-b03f-4636-87c5-5bf70f6f606a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78c4a198-e946-47a4-87fd-31b56613af77"}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:22:43.893876 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-20eb1ba2-b03f-4636-87c5-5bf70f6f606a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:43.901834 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-20eb1ba2-b03f-4636-87c5-5bf70f6f606a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:43.902287 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-20eb1ba2-b03f-4636-87c5-5bf70f6f606a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:43.903515 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-20eb1ba2-b03f-4636-87c5-5bf70f6f606a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:43.904045 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-20eb1ba2-b03f-4636-87c5-5bf70f6f606a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:43.928915 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.wsgi [None req-20eb1ba2-b03f-4636-87c5-5bf70f6f606a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] HTTP exception thrown: Cannot 'attach_volume' instance 68f324c4-3a3e-4e8d-b2ca-91493fae47b1 while it is in vm_state rescued May 25 16:22:43.931088 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-20eb1ba2-b03f-4636-87c5-5bf70f6f606a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Request method failure captured: May 25 16:22:43.931088 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: POST /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1/os-volume_attachments HTTP/1.1 May 25 16:22:43.931088 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:22:43.931088 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:22:43.931088 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:22:43.931088 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 74 May 25 16:22:43.931088 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:22:43.931088 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:22:43.931088 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:22:43.931088 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:22:43.931088 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijldYEk-vXf1RzTAhtuBmZCP64e-jFGtt4_4AUU4JvgXjFozEXheYHuLBoLnaDKX2hw8HHhJRSLtnCpwINlrLr_XZWKytjwNPB5nW99kaEc4sI4nUx8x4Ptx9q5FVs8jmBgiEaPPAaP7XvfqFLdfWYv34Y_gMy5FtTHmgzN_RasZUKJo May 25 16:22:43.931088 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:22:43.931088 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:22:43.931088 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:22:43.931088 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:22:43.931088 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:22:43.931088 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:22:43.931088 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: 95d1e25b20a146c198dfeda0dc43cd72 May 25 16:22:43.931088 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1964636607 May 25 16:22:43.931088 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:22:43.931088 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:22:43.932987 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/95d1e25b20a146c198dfeda0dc43cd72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/95d1e25b20a146c198dfeda0dc43cd72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_95d1e25b20a146c198dfeda0dc43cd72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/95d1e25b20a146c198dfeda0dc43cd72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:22:43.932987 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1964636607 May 25 16:22:43.932987 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: 95d1e25b20a146c198dfeda0dc43cd72 May 25 16:22:43.932987 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1964636607 May 25 16:22:43.932987 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-ServerRescueNegativeTestJSON-1964636607-project May 25 16:22:43.932987 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:22:43.932987 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:22:43.932987 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: 30de794b71b343289491531dfbe37f53 May 25 16:22:43.932987 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1964636607-project May 25 16:22:43.932987 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: May 25 16:22:43.932987 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {"volumeAttachment": {"volumeId": "78c4a198-e946-47a4-87fd-31b56613af77"}} May 25 16:22:43.932987 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: > May 25 16:22:43.933797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Cannot 'attach_volume' instance 68f324c4-3a3e-4e8d-b2ca-91493fae47b1 while it is in vm_state rescued May 25 16:22:43.933797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'server_id': '68f324c4-3a3e-4e8d-b2ca-91493fae47b1', 'body': {'volumeAttachment': {'volumeId': '78c4a198-e946-47a4-87fd-31b56613af77'}}} May 25 16:22:43.933797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:22:43.933797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:22:43.933797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 25 16:22:43.933797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 25 16:22:43.933797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 25 16:22:43.933797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 25 16:22:43.933797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 25 16:22:43.933797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 25 16:22:43.933797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 68f324c4-3a3e-4e8d-b2ca-91493fae47b1 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 25 16:22:43.933797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:22:43.933797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:22:43.933797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:22:43.933797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:22:43.933797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:22:43.933797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:22:43.933797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:22:43.933797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:22:43.935041 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:22:43.935041 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:22:43.935041 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 16:22:43.935041 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 16:22:43.935041 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 16:22:43.935041 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 16:22:43.935041 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 16:22:43.935041 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 16:22:43.935041 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 25 16:22:43.935041 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 25 16:22:43.935041 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 25 16:22:43.935041 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 25 16:22:43.935041 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 68f324c4-3a3e-4e8d-b2ca-91493fae47b1 while it is in vm_state rescued May 25 16:22:43.935041 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:22:43.935041 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:22:43.935041 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:22:43.935041 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:22:43.935041 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:22:43.935041 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:22:43.936290 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:22:43.936290 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:22:43.936290 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 68f324c4-3a3e-4e8d-b2ca-91493fae47b1 while it is in vm_state rescued May 25 16:22:43.936290 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:22:43.936290 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-20eb1ba2-b03f-4636-87c5-5bf70f6f606a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Returning 409 to user: Cannot 'attach_volume' instance 68f324c4-3a3e-4e8d-b2ca-91493fae47b1 while it is in vm_state rescued {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:22:43.936290 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-20eb1ba2-b03f-4636-87c5-5bf70f6f606a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "POST /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044435 May 25 16:22:43.942832 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-41cbfbcf-8056-4eed-8de3-fb20ba5d470e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:22:43.943364 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-41cbfbcf-8056-4eed-8de3-fb20ba5d470e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:43.946925 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 140/284] 10.222.0.42 () {60 vars in 1322 bytes} [Wed May 25 16:22:43 2022] POST /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1/os-volume_attachments => generated 152 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 25 16:22:43.950282 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-41cbfbcf-8056-4eed-8de3-fb20ba5d470e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:43.950733 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-41cbfbcf-8056-4eed-8de3-fb20ba5d470e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:43.951500 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-41cbfbcf-8056-4eed-8de3-fb20ba5d470e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:43.951934 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-41cbfbcf-8056-4eed-8de3-fb20ba5d470e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:43.989085 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-269c0f07-0a3b-46b2-b526-b6bfed486382 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:43.990521 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-269c0f07-0a3b-46b2-b526-b6bfed486382 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:44.000998 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-269c0f07-0a3b-46b2-b526-b6bfed486382 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:44.002096 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-269c0f07-0a3b-46b2-b526-b6bfed486382 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:44.003198 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-269c0f07-0a3b-46b2-b526-b6bfed486382 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:44.004091 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-269c0f07-0a3b-46b2-b526-b6bfed486382 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:44.040547 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-41cbfbcf-8056-4eed-8de3-fb20ba5d470e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "POST /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1/action" status: 202 len: 0 microversion: 2.1 time: 0.100218 May 25 16:22:44.041609 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 145/285] 10.222.0.42 () {60 vars in 1277 bytes} [Wed May 25 16:22:43 2022] POST /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:22:44.050772 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-2387465c-30d1-4775-b5ef-cfe9f8e862b8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:44.052073 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-2387465c-30d1-4775-b5ef-cfe9f8e862b8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:44.061734 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2387465c-30d1-4775-b5ef-cfe9f8e862b8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:44.063489 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2387465c-30d1-4775-b5ef-cfe9f8e862b8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:44.063489 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2387465c-30d1-4775-b5ef-cfe9f8e862b8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:44.064059 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2387465c-30d1-4775-b5ef-cfe9f8e862b8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:44.365030 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-2387465c-30d1-4775-b5ef-cfe9f8e862b8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:44.377010 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-269c0f07-0a3b-46b2-b526-b6bfed486382 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:44.392248 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-2387465c-30d1-4775-b5ef-cfe9f8e862b8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1508 microversion: 2.1 time: 0.340870 May 25 16:22:44.399187 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-269c0f07-0a3b-46b2-b526-b6bfed486382 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760" status: 200 len: 1267 microversion: 2.1 time: 0.408503 May 25 16:22:44.400086 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 141/286] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:43 2022] GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 => generated 1267 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:44.405502 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 146/287] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:44 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1508 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:44.406457 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-cef40b64-a448-4151-a133-9d3640690b6c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:44.407313 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-cef40b64-a448-4151-a133-9d3640690b6c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 867f3a7b-7e7e-468a-b1a3-9c71cc196f23] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:44.410966 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-9fbc482d-510a-40fc-8022-317546cd2fae tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:44.412651 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-9fbc482d-510a-40fc-8022-317546cd2fae tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:44.420075 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9fbc482d-510a-40fc-8022-317546cd2fae tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:44.420936 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9fbc482d-510a-40fc-8022-317546cd2fae tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:44.421903 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9fbc482d-510a-40fc-8022-317546cd2fae tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:44.422780 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9fbc482d-510a-40fc-8022-317546cd2fae tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:44.423706 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-cef40b64-a448-4151-a133-9d3640690b6c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:44.424283 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-cef40b64-a448-4151-a133-9d3640690b6c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:44.425698 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-cef40b64-a448-4151-a133-9d3640690b6c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:44.426264 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-cef40b64-a448-4151-a133-9d3640690b6c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:44.731653 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-cef40b64-a448-4151-a133-9d3640690b6c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:44.737187 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-9fbc482d-510a-40fc-8022-317546cd2fae tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:44.746385 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-cef40b64-a448-4151-a133-9d3640690b6c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23" status: 200 len: 1367 microversion: 2.1 time: 0.344164 May 25 16:22:44.748092 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-9fbc482d-510a-40fc-8022-317546cd2fae tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:44.749607 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-9fbc482d-510a-40fc-8022-317546cd2fae tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:44.750972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-9fbc482d-510a-40fc-8022-317546cd2fae tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1722 microversion: 2.20 time: 0.344056 May 25 16:22:44.751534 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 147/288] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:22:44 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1722 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:22:44.761395 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 142/289] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:44 2022] GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23 => generated 1367 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:44.761395 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-feca427b-6da3-4635-989b-3254df7eb8e1 req-d8c6fb51-c73e-44d7-a280-06cfdf62e9f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2ffa3b0-9de0-483c-86b7-0f18718d8760", "tag": "b584eb77-9528-491e-9943-03658d935cdc"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:22:44.765912 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-feca427b-6da3-4635-989b-3254df7eb8e1 req-d8c6fb51-c73e-44d7-a280-06cfdf62e9f3 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:44.766185 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-32149327-b359-4cb5-8cb5-5a3a30bd3777 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f3f968b-3f2d-4620-8169-a8c52db84c27"}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:22:44.766357 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-feca427b-6da3-4635-989b-3254df7eb8e1 req-d8c6fb51-c73e-44d7-a280-06cfdf62e9f3 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:44.767318 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-32149327-b359-4cb5-8cb5-5a3a30bd3777 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:44.775798 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-32149327-b359-4cb5-8cb5-5a3a30bd3777 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:44.776366 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-32149327-b359-4cb5-8cb5-5a3a30bd3777 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:44.777213 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-32149327-b359-4cb5-8cb5-5a3a30bd3777 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:44.777732 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-32149327-b359-4cb5-8cb5-5a3a30bd3777 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:44.779742 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-feca427b-6da3-4635-989b-3254df7eb8e1 req-d8c6fb51-c73e-44d7-a280-06cfdf62e9f3 service nova] Creating event network-changed:b584eb77-9528-491e-9943-03658d935cdc for instance c2ffa3b0-9de0-483c-86b7-0f18718d8760 on hv-cinder-84327 May 25 16:22:44.784996 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-feca427b-6da3-4635-989b-3254df7eb8e1 req-d8c6fb51-c73e-44d7-a280-06cfdf62e9f3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031441 May 25 16:22:44.785793 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 143/290] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:22:45.411844 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-ff21d610-887a-4f1b-bc96-7f0cb622a6c0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:45.412801 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-ff21d610-887a-4f1b-bc96-7f0cb622a6c0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:45.419471 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ff21d610-887a-4f1b-bc96-7f0cb622a6c0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:45.419921 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ff21d610-887a-4f1b-bc96-7f0cb622a6c0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:45.420679 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ff21d610-887a-4f1b-bc96-7f0cb622a6c0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:45.421115 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ff21d610-887a-4f1b-bc96-7f0cb622a6c0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:45.553378 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-ff21d610-887a-4f1b-bc96-7f0cb622a6c0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:45.561772 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-ff21d610-887a-4f1b-bc96-7f0cb622a6c0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1508 microversion: 2.1 time: 0.154237 May 25 16:22:45.562329 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 144/291] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:45 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:22:45.566612 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-2f22491d-beec-4b50-974a-cc0a51b553fe tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:45.567200 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-2f22491d-beec-4b50-974a-cc0a51b553fe tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:45.573232 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2f22491d-beec-4b50-974a-cc0a51b553fe tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:45.573673 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2f22491d-beec-4b50-974a-cc0a51b553fe tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:45.574444 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2f22491d-beec-4b50-974a-cc0a51b553fe tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:45.574870 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2f22491d-beec-4b50-974a-cc0a51b553fe tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:45.701971 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-2f22491d-beec-4b50-974a-cc0a51b553fe tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:45.709251 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-2f22491d-beec-4b50-974a-cc0a51b553fe tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760" status: 200 len: 1267 microversion: 2.1 time: 0.145999 May 25 16:22:45.709835 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 145/292] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:45 2022] GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:45.768076 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-66e842b3-018c-4e1d-9978-535aa91d55fc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:45.768679 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-66e842b3-018c-4e1d-9978-535aa91d55fc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:45.776018 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-66e842b3-018c-4e1d-9978-535aa91d55fc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:45.776471 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-66e842b3-018c-4e1d-9978-535aa91d55fc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:45.777242 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-66e842b3-018c-4e1d-9978-535aa91d55fc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:45.777681 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-66e842b3-018c-4e1d-9978-535aa91d55fc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:45.902884 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-66e842b3-018c-4e1d-9978-535aa91d55fc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:45.910688 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-66e842b3-018c-4e1d-9978-535aa91d55fc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:45.912706 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-66e842b3-018c-4e1d-9978-535aa91d55fc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:45.913920 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-66e842b3-018c-4e1d-9978-535aa91d55fc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1722 microversion: 2.20 time: 0.149568 May 25 16:22:45.914485 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 146/293] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:22:45 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:22:45.919387 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-1e7b9154-4e41-41ad-95c9-572c8e538705 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:45.919988 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-1e7b9154-4e41-41ad-95c9-572c8e538705 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 867f3a7b-7e7e-468a-b1a3-9c71cc196f23] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:45.925661 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1e7b9154-4e41-41ad-95c9-572c8e538705 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:45.926140 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1e7b9154-4e41-41ad-95c9-572c8e538705 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:45.926890 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1e7b9154-4e41-41ad-95c9-572c8e538705 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:45.927320 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1e7b9154-4e41-41ad-95c9-572c8e538705 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:46.053924 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-1e7b9154-4e41-41ad-95c9-572c8e538705 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:46.061231 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-1e7b9154-4e41-41ad-95c9-572c8e538705 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23" status: 200 len: 1367 microversion: 2.1 time: 0.145811 May 25 16:22:46.061815 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 147/294] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:45 2022] GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:46.578798 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-fa8a348d-582d-4407-b047-f2754e0e3590 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:46.579414 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-fa8a348d-582d-4407-b047-f2754e0e3590 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:46.585559 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fa8a348d-582d-4407-b047-f2754e0e3590 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:46.586138 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fa8a348d-582d-4407-b047-f2754e0e3590 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:46.586905 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fa8a348d-582d-4407-b047-f2754e0e3590 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:46.587347 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fa8a348d-582d-4407-b047-f2754e0e3590 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:46.716968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-fa8a348d-582d-4407-b047-f2754e0e3590 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:46.746040 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-fa8a348d-582d-4407-b047-f2754e0e3590 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1508 microversion: 2.1 time: 0.170900 May 25 16:22:46.746671 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 148/295] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:46 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:22:46.754840 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-3338ae4a-d7ff-4369-a18c-52eab1d81f85 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:46.754840 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-3338ae4a-d7ff-4369-a18c-52eab1d81f85 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:46.761211 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3338ae4a-d7ff-4369-a18c-52eab1d81f85 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:46.761663 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3338ae4a-d7ff-4369-a18c-52eab1d81f85 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:46.762459 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3338ae4a-d7ff-4369-a18c-52eab1d81f85 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:46.762899 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3338ae4a-d7ff-4369-a18c-52eab1d81f85 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:46.938602 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-32149327-b359-4cb5-8cb5-5a3a30bd3777 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "POST /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.184845 May 25 16:22:46.939628 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 148/296] 10.222.0.42 () {60 vars in 1322 bytes} [Wed May 25 16:22:44 2022] POST /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f/os-volume_attachments => generated 194 bytes in 2188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:22:46.966037 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-188ee590-b319-4cb8-9bfc-af6528042db0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:46.967196 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-188ee590-b319-4cb8-9bfc-af6528042db0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:46.979399 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-188ee590-b319-4cb8-9bfc-af6528042db0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:46.980097 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-188ee590-b319-4cb8-9bfc-af6528042db0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:46.982309 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-188ee590-b319-4cb8-9bfc-af6528042db0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:46.983903 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-188ee590-b319-4cb8-9bfc-af6528042db0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:47.018628 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-3338ae4a-d7ff-4369-a18c-52eab1d81f85 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:47.028605 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-3338ae4a-d7ff-4369-a18c-52eab1d81f85 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760" status: 200 len: 1267 microversion: 2.1 time: 0.280858 May 25 16:22:47.029186 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 149/297] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:46 2022] GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 => generated 1267 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:47.078827 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-7105f35b-bf6e-4a20-9fcf-143824ac6eea tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:47.079445 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-7105f35b-bf6e-4a20-9fcf-143824ac6eea tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 867f3a7b-7e7e-468a-b1a3-9c71cc196f23] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:47.086551 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7105f35b-bf6e-4a20-9fcf-143824ac6eea tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:47.087009 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7105f35b-bf6e-4a20-9fcf-143824ac6eea tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:47.088091 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7105f35b-bf6e-4a20-9fcf-143824ac6eea tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:47.088549 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7105f35b-bf6e-4a20-9fcf-143824ac6eea tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:47.370586 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-188ee590-b319-4cb8-9bfc-af6528042db0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:47.374584 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-7105f35b-bf6e-4a20-9fcf-143824ac6eea tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:47.380658 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-188ee590-b319-4cb8-9bfc-af6528042db0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:47.383430 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-188ee590-b319-4cb8-9bfc-af6528042db0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:47.384945 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-188ee590-b319-4cb8-9bfc-af6528042db0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1722 microversion: 2.20 time: 0.443376 May 25 16:22:47.385870 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-7105f35b-bf6e-4a20-9fcf-143824ac6eea tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23" status: 200 len: 1367 microversion: 2.1 time: 0.311287 May 25 16:22:47.396484 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 150/298] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:47 2022] GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23 => generated 1367 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:22:47.397451 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 149/299] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:22:46 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1722 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:22:47.763651 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-69419f81-b650-4188-a9ed-8958175136fb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:47.764238 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-69419f81-b650-4188-a9ed-8958175136fb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:47.770919 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-69419f81-b650-4188-a9ed-8958175136fb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:47.771672 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-69419f81-b650-4188-a9ed-8958175136fb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:47.772705 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-69419f81-b650-4188-a9ed-8958175136fb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:47.774089 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-69419f81-b650-4188-a9ed-8958175136fb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:47.933226 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-0df3bf21-2efc-4e11-9eb5-3c027c2968c2 req-96202e2c-2ae8-41cf-8094-face4fa2a8ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "867f3a7b-7e7e-468a-b1a3-9c71cc196f23", "tag": "6671911c-5350-4820-bfd8-8e86bc7f1151"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:22:47.955275 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-0df3bf21-2efc-4e11-9eb5-3c027c2968c2 req-96202e2c-2ae8-41cf-8094-face4fa2a8ed service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:47.955892 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-0df3bf21-2efc-4e11-9eb5-3c027c2968c2 req-96202e2c-2ae8-41cf-8094-face4fa2a8ed service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:47.961968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-69419f81-b650-4188-a9ed-8958175136fb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:47.969872 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-0df3bf21-2efc-4e11-9eb5-3c027c2968c2 req-96202e2c-2ae8-41cf-8094-face4fa2a8ed service nova] Creating event network-changed:6671911c-5350-4820-bfd8-8e86bc7f1151 for instance 867f3a7b-7e7e-468a-b1a3-9c71cc196f23 on hv-cinder-84327 May 25 16:22:47.974959 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-0df3bf21-2efc-4e11-9eb5-3c027c2968c2 req-96202e2c-2ae8-41cf-8094-face4fa2a8ed service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045642 May 25 16:22:47.979094 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 150/300] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:22:47.984411 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-69419f81-b650-4188-a9ed-8958175136fb tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1508 microversion: 2.1 time: 0.224857 May 25 16:22:47.991003 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 151/301] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:47 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1508 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:48.046168 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-1a89a31b-9463-40ff-b36a-7c5d8969da7e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:48.046868 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-1a89a31b-9463-40ff-b36a-7c5d8969da7e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:48.058456 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1a89a31b-9463-40ff-b36a-7c5d8969da7e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:48.058909 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1a89a31b-9463-40ff-b36a-7c5d8969da7e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:48.059690 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1a89a31b-9463-40ff-b36a-7c5d8969da7e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:48.060300 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1a89a31b-9463-40ff-b36a-7c5d8969da7e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:48.214603 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-1a89a31b-9463-40ff-b36a-7c5d8969da7e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:48.223551 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-1a89a31b-9463-40ff-b36a-7c5d8969da7e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760" status: 200 len: 1267 microversion: 2.1 time: 0.182428 May 25 16:22:48.224123 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 151/302] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:48 2022] GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:48.404070 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-6c4fa771-d6d1-43e0-8820-dc7439c93f3d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:48.404312 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-9d69f89a-41f4-4809-9200-4bcf97267179 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:48.404920 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-6c4fa771-d6d1-43e0-8820-dc7439c93f3d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:48.405037 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-9d69f89a-41f4-4809-9200-4bcf97267179 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 867f3a7b-7e7e-468a-b1a3-9c71cc196f23] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:48.411073 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9d69f89a-41f4-4809-9200-4bcf97267179 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:48.411524 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9d69f89a-41f4-4809-9200-4bcf97267179 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:48.412141 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6c4fa771-d6d1-43e0-8820-dc7439c93f3d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:48.412292 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9d69f89a-41f4-4809-9200-4bcf97267179 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:48.412985 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9d69f89a-41f4-4809-9200-4bcf97267179 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:48.413101 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6c4fa771-d6d1-43e0-8820-dc7439c93f3d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:48.414714 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6c4fa771-d6d1-43e0-8820-dc7439c93f3d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:48.415143 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6c4fa771-d6d1-43e0-8820-dc7439c93f3d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:48.608610 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-6c4fa771-d6d1-43e0-8820-dc7439c93f3d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:48.612602 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-9d69f89a-41f4-4809-9200-4bcf97267179 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:48.616699 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-6c4fa771-d6d1-43e0-8820-dc7439c93f3d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:48.618262 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-6c4fa771-d6d1-43e0-8820-dc7439c93f3d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:48.619535 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-6c4fa771-d6d1-43e0-8820-dc7439c93f3d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1722 microversion: 2.20 time: 0.219410 May 25 16:22:48.628191 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 152/303] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:22:48 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:22:48.628344 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-9d69f89a-41f4-4809-9200-4bcf97267179 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23" status: 200 len: 1367 microversion: 2.1 time: 0.220989 May 25 16:22:48.628344 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 152/304] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:48 2022] GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:22:49.002204 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-0b76b4db-4d6b-437f-af8e-54ceb899977c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:49.002840 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-0b76b4db-4d6b-437f-af8e-54ceb899977c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:49.009578 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0b76b4db-4d6b-437f-af8e-54ceb899977c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:49.010057 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0b76b4db-4d6b-437f-af8e-54ceb899977c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:49.010819 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0b76b4db-4d6b-437f-af8e-54ceb899977c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:49.011258 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0b76b4db-4d6b-437f-af8e-54ceb899977c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:49.141778 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-0b76b4db-4d6b-437f-af8e-54ceb899977c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:49.152009 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-0b76b4db-4d6b-437f-af8e-54ceb899977c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1508 microversion: 2.1 time: 0.153619 May 25 16:22:49.152777 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 153/305] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:48 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:49.242868 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-a4ea75dd-8a80-4fd9-b993-fbeb4f9bed7c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:49.243555 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-a4ea75dd-8a80-4fd9-b993-fbeb4f9bed7c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:49.251394 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a4ea75dd-8a80-4fd9-b993-fbeb4f9bed7c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:49.251851 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a4ea75dd-8a80-4fd9-b993-fbeb4f9bed7c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:49.252671 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a4ea75dd-8a80-4fd9-b993-fbeb4f9bed7c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:49.253059 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a4ea75dd-8a80-4fd9-b993-fbeb4f9bed7c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:49.404701 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-a4ea75dd-8a80-4fd9-b993-fbeb4f9bed7c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:49.412313 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-a4ea75dd-8a80-4fd9-b993-fbeb4f9bed7c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760" status: 200 len: 1267 microversion: 2.1 time: 0.175549 May 25 16:22:49.413144 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 153/306] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:49 2022] GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:49.638370 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-96b1c02b-0155-4331-8cfb-da3100bf0bb3 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:49.638974 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-96b1c02b-0155-4331-8cfb-da3100bf0bb3 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:49.639079 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-0cfaf159-bbe6-4027-a064-9aea942c1b09 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:49.639689 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-0cfaf159-bbe6-4027-a064-9aea942c1b09 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 867f3a7b-7e7e-468a-b1a3-9c71cc196f23] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:49.640955 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:22:49.641836 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell0:SELECT=6 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:22:49.646332 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-96b1c02b-0155-4331-8cfb-da3100bf0bb3 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:49.646779 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-96b1c02b-0155-4331-8cfb-da3100bf0bb3 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:49.647276 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0cfaf159-bbe6-4027-a064-9aea942c1b09 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:49.647545 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-96b1c02b-0155-4331-8cfb-da3100bf0bb3 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:49.647732 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0cfaf159-bbe6-4027-a064-9aea942c1b09 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:49.648234 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-96b1c02b-0155-4331-8cfb-da3100bf0bb3 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:49.648500 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0cfaf159-bbe6-4027-a064-9aea942c1b09 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:49.648932 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0cfaf159-bbe6-4027-a064-9aea942c1b09 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:49.869367 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-96b1c02b-0155-4331-8cfb-da3100bf0bb3 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:49.878533 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-96b1c02b-0155-4331-8cfb-da3100bf0bb3 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:49.879411 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-0cfaf159-bbe6-4027-a064-9aea942c1b09 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:49.880329 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-96b1c02b-0155-4331-8cfb-da3100bf0bb3 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:49.881523 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-96b1c02b-0155-4331-8cfb-da3100bf0bb3 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1722 microversion: 2.20 time: 0.247142 May 25 16:22:49.882508 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 154/307] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:22:49 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:22:49.887222 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-0cfaf159-bbe6-4027-a064-9aea942c1b09 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23" status: 200 len: 1367 microversion: 2.1 time: 0.251992 May 25 16:22:49.888073 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 154/308] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:49 2022] GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23 => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:22:50.171138 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-2f0b7be3-6d7f-481c-b79b-8cdec01eb36c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:50.171774 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-2f0b7be3-6d7f-481c-b79b-8cdec01eb36c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:50.180849 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2f0b7be3-6d7f-481c-b79b-8cdec01eb36c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:50.181292 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2f0b7be3-6d7f-481c-b79b-8cdec01eb36c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:50.182090 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2f0b7be3-6d7f-481c-b79b-8cdec01eb36c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:50.182818 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2f0b7be3-6d7f-481c-b79b-8cdec01eb36c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:50.314280 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-2f0b7be3-6d7f-481c-b79b-8cdec01eb36c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:50.332765 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-2f0b7be3-6d7f-481c-b79b-8cdec01eb36c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1514 microversion: 2.1 time: 0.166051 May 25 16:22:50.333592 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 155/309] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:50 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:50.431619 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-4fe511e0-63f0-46f6-8096-055a4ed028c3 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:50.432894 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-4fe511e0-63f0-46f6-8096-055a4ed028c3 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:50.440220 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4fe511e0-63f0-46f6-8096-055a4ed028c3 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:50.440858 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4fe511e0-63f0-46f6-8096-055a4ed028c3 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:50.441635 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4fe511e0-63f0-46f6-8096-055a4ed028c3 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:50.442102 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4fe511e0-63f0-46f6-8096-055a4ed028c3 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:50.447297 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:22:50.603524 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-4fe511e0-63f0-46f6-8096-055a4ed028c3 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:50.620562 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-4fe511e0-63f0-46f6-8096-055a4ed028c3 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760" status: 200 len: 1267 microversion: 2.1 time: 0.195915 May 25 16:22:50.621325 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 155/310] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:50 2022] GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 => generated 1267 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:50.905204 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-64507b6b-ac14-448f-9ba8-d26680952b47 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:50.905326 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-abe8ff68-546b-4417-b23b-1f1b9f65ca0c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:50.905847 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-64507b6b-ac14-448f-9ba8-d26680952b47 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 867f3a7b-7e7e-468a-b1a3-9c71cc196f23] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:50.906005 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-abe8ff68-546b-4417-b23b-1f1b9f65ca0c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:50.911973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-64507b6b-ac14-448f-9ba8-d26680952b47 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:50.912875 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-64507b6b-ac14-448f-9ba8-d26680952b47 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:50.914828 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-64507b6b-ac14-448f-9ba8-d26680952b47 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:50.915259 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-64507b6b-ac14-448f-9ba8-d26680952b47 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:50.916076 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-abe8ff68-546b-4417-b23b-1f1b9f65ca0c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:50.916587 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-abe8ff68-546b-4417-b23b-1f1b9f65ca0c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:50.917447 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-abe8ff68-546b-4417-b23b-1f1b9f65ca0c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:50.917936 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-abe8ff68-546b-4417-b23b-1f1b9f65ca0c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:50.922121 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:22:51.134088 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-abe8ff68-546b-4417-b23b-1f1b9f65ca0c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:51.137813 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-64507b6b-ac14-448f-9ba8-d26680952b47 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:51.142973 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-abe8ff68-546b-4417-b23b-1f1b9f65ca0c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:51.144754 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-abe8ff68-546b-4417-b23b-1f1b9f65ca0c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:51.146110 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-abe8ff68-546b-4417-b23b-1f1b9f65ca0c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1722 microversion: 2.20 time: 0.249898 May 25 16:22:51.146737 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 156/311] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:22:50 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:22:51.149034 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-64507b6b-ac14-448f-9ba8-d26680952b47 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23" status: 200 len: 1367 microversion: 2.1 time: 0.247336 May 25 16:22:51.150138 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 156/312] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:50 2022] GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23 => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:22:51.640602 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-b309cc5c-cf4f-4709-9b50-818e5e6f91d9 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:51.641211 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-b309cc5c-cf4f-4709-9b50-818e5e6f91d9 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:51.647121 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b309cc5c-cf4f-4709-9b50-818e5e6f91d9 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:51.647570 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b309cc5c-cf4f-4709-9b50-818e5e6f91d9 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:51.648380 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b309cc5c-cf4f-4709-9b50-818e5e6f91d9 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:51.648930 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b309cc5c-cf4f-4709-9b50-818e5e6f91d9 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:51.712765 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell0:SELECT=4 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:22:51.734900 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-1ecaf2db-96ed-4ddf-b4a4-2758c87f6eea tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Action: 'create', calling method: .version_select at 0x7f51eda7f9d0>, body: {"keypair": {"name": "tempest-keypair-1403812730", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/kCgD1IA49fNoM3XM2XggMwjol/TRo0o/CzKunDu+/bnwgg3uLpogdecpYjTV9XQhRrmqrMDz6uzc7nVWGhonFwJ+Jrk3Ld1mwriZB3Uv0ExDBzAzHNWUWl4eRJSASMg=="}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:22:51.750147 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-1ecaf2db-96ed-4ddf-b4a4-2758c87f6eea tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Getting quotas for project 95d1e25b20a146c198dfeda0dc43cd72. Resources: {'key_pairs'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:22:51.754753 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-1ecaf2db-96ed-4ddf-b4a4-2758c87f6eea tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Getting quotas for user 30de794b71b343289491531dfbe37f53 and project 95d1e25b20a146c198dfeda0dc43cd72. Resources: {'key_pairs'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:22:51.784357 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-1ecaf2db-96ed-4ddf-b4a4-2758c87f6eea tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053499 May 25 16:22:51.785227 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 157/313] 10.222.0.42 () {60 vars in 1158 bytes} [Wed May 25 16:22:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:22:51.830321 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-b309cc5c-cf4f-4709-9b50-818e5e6f91d9 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:51.839568 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-b309cc5c-cf4f-4709-9b50-818e5e6f91d9 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760" status: 200 len: 1267 microversion: 2.1 time: 0.202928 May 25 16:22:51.840347 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 157/314] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:51 2022] GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 => generated 1267 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:52.167441 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-aab05642-f26f-4fba-96a8-1604fb55923e tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:52.169340 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-aab05642-f26f-4fba-96a8-1604fb55923e tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 867f3a7b-7e7e-468a-b1a3-9c71cc196f23] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:52.169830 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-c9a4990f-ba34-4952-8d1b-cf4a2bae6b50 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:52.170526 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-c9a4990f-ba34-4952-8d1b-cf4a2bae6b50 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:52.173165 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell0:SELECT=14 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:22:52.179263 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-aab05642-f26f-4fba-96a8-1604fb55923e tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:52.179897 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c9a4990f-ba34-4952-8d1b-cf4a2bae6b50 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:52.180144 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-aab05642-f26f-4fba-96a8-1604fb55923e tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:52.180467 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c9a4990f-ba34-4952-8d1b-cf4a2bae6b50 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:52.180931 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-aab05642-f26f-4fba-96a8-1604fb55923e tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:52.181372 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-aab05642-f26f-4fba-96a8-1604fb55923e tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:52.181530 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c9a4990f-ba34-4952-8d1b-cf4a2bae6b50 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:52.182413 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c9a4990f-ba34-4952-8d1b-cf4a2bae6b50 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:52.474126 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-aab05642-f26f-4fba-96a8-1604fb55923e tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:52.478972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-c9a4990f-ba34-4952-8d1b-cf4a2bae6b50 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:52.485547 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-aab05642-f26f-4fba-96a8-1604fb55923e tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23" status: 200 len: 1367 microversion: 2.1 time: 0.323068 May 25 16:22:52.487378 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 158/315] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:52 2022] GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23 => generated 1367 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:22:52.489900 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-c9a4990f-ba34-4952-8d1b-cf4a2bae6b50 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:52.492068 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-c9a4990f-ba34-4952-8d1b-cf4a2bae6b50 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:52.493698 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-c9a4990f-ba34-4952-8d1b-cf4a2bae6b50 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1722 microversion: 2.20 time: 0.332231 May 25 16:22:52.506251 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 158/316] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:22:52 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1722 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:22:52.859913 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-dad6a0b2-ae55-4b35-a13d-f2bb4a8108cb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:52.862625 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-dad6a0b2-ae55-4b35-a13d-f2bb4a8108cb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:52.873212 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dad6a0b2-ae55-4b35-a13d-f2bb4a8108cb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:52.874329 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dad6a0b2-ae55-4b35-a13d-f2bb4a8108cb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:52.877887 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dad6a0b2-ae55-4b35-a13d-f2bb4a8108cb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:52.878618 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dad6a0b2-ae55-4b35-a13d-f2bb4a8108cb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:53.071583 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-dad6a0b2-ae55-4b35-a13d-f2bb4a8108cb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:53.081686 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-dad6a0b2-ae55-4b35-a13d-f2bb4a8108cb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760" status: 200 len: 1267 microversion: 2.1 time: 0.228342 May 25 16:22:53.093460 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 159/317] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:52 2022] GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 => generated 1267 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:53.505727 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-dd2da8a7-16fe-4679-bc95-163453467619 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:53.509098 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-dd2da8a7-16fe-4679-bc95-163453467619 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 867f3a7b-7e7e-468a-b1a3-9c71cc196f23] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:53.514767 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-37e52ee2-133d-4a2c-ada5-82513aff753f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:53.515361 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-37e52ee2-133d-4a2c-ada5-82513aff753f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:53.525020 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dd2da8a7-16fe-4679-bc95-163453467619 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:53.525826 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dd2da8a7-16fe-4679-bc95-163453467619 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:53.525969 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-37e52ee2-133d-4a2c-ada5-82513aff753f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:53.526593 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-37e52ee2-133d-4a2c-ada5-82513aff753f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:53.526942 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dd2da8a7-16fe-4679-bc95-163453467619 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:53.527451 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dd2da8a7-16fe-4679-bc95-163453467619 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:53.527867 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-37e52ee2-133d-4a2c-ada5-82513aff753f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:53.528445 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-37e52ee2-133d-4a2c-ada5-82513aff753f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:53.745460 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-dd2da8a7-16fe-4679-bc95-163453467619 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:53.746101 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-37e52ee2-133d-4a2c-ada5-82513aff753f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:53.754119 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-37e52ee2-133d-4a2c-ada5-82513aff753f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:53.755638 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-37e52ee2-133d-4a2c-ada5-82513aff753f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:53.756773 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-dd2da8a7-16fe-4679-bc95-163453467619 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23" status: 200 len: 1367 microversion: 2.1 time: 0.255031 May 25 16:22:53.757432 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-37e52ee2-133d-4a2c-ada5-82513aff753f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1722 microversion: 2.20 time: 0.245860 May 25 16:22:53.760479 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 159/318] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:53 2022] GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23 => generated 1367 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:22:53.768173 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 160/319] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:22:53 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:22:53.872584 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-6d95e10a-b40b-4cc8-af20-03210b0c994b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-186407494", "imageRef": "e74cccc1-cd1b-4dfc-8e47-3e4a832649a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "07eab40d-bc82-4433-9d88-2c85f65e23df"}], "security_groups": [{"name": "tempest-securitygroup--854874106"}], "key_name": "tempest-keypair-1403812730", "user_data": "}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:22:53.980500 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.network.neutron [None req-6d95e10a-b40b-4cc8-af20-03210b0c994b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] validate_networks() for [('07eab40d-bc82-4433-9d88-2c85f65e23df', None, None, None, None, None)] {{(pid=117510) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:22:54.101747 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-6d14b680-99bf-484a-a741-c6b6867f6ddf tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:54.103134 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-6d14b680-99bf-484a-a741-c6b6867f6ddf tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:54.109137 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6d14b680-99bf-484a-a741-c6b6867f6ddf tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:54.109591 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6d14b680-99bf-484a-a741-c6b6867f6ddf tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:54.110416 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6d14b680-99bf-484a-a741-c6b6867f6ddf tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:54.110855 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6d14b680-99bf-484a-a741-c6b6867f6ddf tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:54.531980 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-6d14b680-99bf-484a-a741-c6b6867f6ddf tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:54.558105 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-6d14b680-99bf-484a-a741-c6b6867f6ddf tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760" status: 200 len: 1267 microversion: 2.1 time: 0.461539 May 25 16:22:54.558703 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 161/320] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:54 2022] GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 => generated 1267 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:22:54.590821 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-b474fd06-b4be-4738-92af-c78aedbaf203 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:22:54.598169 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b474fd06-b4be-4738-92af-c78aedbaf203 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:54.598980 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b474fd06-b4be-4738-92af-c78aedbaf203 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:54.664094 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-b474fd06-b4be-4738-92af-c78aedbaf203 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Going to try to stop instance {{(pid=117509) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 25 16:22:54.665508 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-6d95e10a-b40b-4cc8-af20-03210b0c994b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Flavor limits 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:22:54.666018 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-6d95e10a-b40b-4cc8-af20-03210b0c994b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Image limits 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:22:54.666535 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-6d95e10a-b40b-4cc8-af20-03210b0c994b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Flavor pref 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:22:54.667015 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-6d95e10a-b40b-4cc8-af20-03210b0c994b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Image pref 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:22:54.667667 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-6d95e10a-b40b-4cc8-af20-03210b0c994b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:22:54.677099 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6d95e10a-b40b-4cc8-af20-03210b0c994b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:54.677656 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6d95e10a-b40b-4cc8-af20-03210b0c994b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:54.678578 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6d95e10a-b40b-4cc8-af20-03210b0c994b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:54.679143 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6d95e10a-b40b-4cc8-af20-03210b0c994b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:54.697835 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-6d95e10a-b40b-4cc8-af20-03210b0c994b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Getting quotas for project 95d1e25b20a146c198dfeda0dc43cd72. Resources: {'ram', 'cores', 'instances'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:22:54.702174 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-6d95e10a-b40b-4cc8-af20-03210b0c994b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Getting quotas for user 30de794b71b343289491531dfbe37f53 and project 95d1e25b20a146c198dfeda0dc43cd72. Resources: {'ram', 'cores', 'instances'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:22:54.715081 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-6d95e10a-b40b-4cc8-af20-03210b0c994b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Going to run 1 instances... {{(pid=117510) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:22:54.715291 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-b474fd06-b4be-4738-92af-c78aedbaf203 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "POST /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f/action" status: 202 len: 0 microversion: 2.1 time: 0.128732 May 25 16:22:54.717509 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-6d95e10a-b40b-4cc8-af20-03210b0c994b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e74cccc1-cd1b-4dfc-8e47-3e4a832649a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:22:54.718808 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 162/321] 10.222.0.42 () {60 vars in 1277 bytes} [Wed May 25 16:22:54 2022] POST /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:22:54.729123 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-64211905-8ee2-43e6-ad8e-56bee2bf82b8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:54.729907 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-64211905-8ee2-43e6-ad8e-56bee2bf82b8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:54.736746 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-64211905-8ee2-43e6-ad8e-56bee2bf82b8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:54.737285 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-64211905-8ee2-43e6-ad8e-56bee2bf82b8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:54.738081 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-64211905-8ee2-43e6-ad8e-56bee2bf82b8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:54.738681 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-64211905-8ee2-43e6-ad8e-56bee2bf82b8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:54.765893 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-6d95e10a-b40b-4cc8-af20-03210b0c994b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.897771 May 25 16:22:54.766789 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 160/322] 10.222.0.42 () {60 vars in 1146 bytes} [Wed May 25 16:22:53 2022] POST /compute/v2.1/servers => generated 408 bytes in 900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 25 16:22:54.777374 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-c59d8ca1-600c-43c3-8a89-e38738aae117 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:54.778020 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-c59d8ca1-600c-43c3-8a89-e38738aae117 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:54.785281 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c59d8ca1-600c-43c3-8a89-e38738aae117 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:54.785767 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c59d8ca1-600c-43c3-8a89-e38738aae117 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:54.786534 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c59d8ca1-600c-43c3-8a89-e38738aae117 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:54.787122 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c59d8ca1-600c-43c3-8a89-e38738aae117 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:54.972619 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-64211905-8ee2-43e6-ad8e-56bee2bf82b8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:54.981255 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-64211905-8ee2-43e6-ad8e-56bee2bf82b8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1723 microversion: 2.1 time: 0.259815 May 25 16:22:54.982212 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 163/323] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:54 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:54.992177 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-c59d8ca1-600c-43c3-8a89-e38738aae117 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:54.994730 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-c59d8ca1-600c-43c3-8a89-e38738aae117 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:54.997234 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-c59d8ca1-600c-43c3-8a89-e38738aae117 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:54.998502 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-c59d8ca1-600c-43c3-8a89-e38738aae117 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1722 microversion: 2.20 time: 0.226871 May 25 16:22:54.998882 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-4f9e27b2-e9fd-434d-b473-d2d0221dc920 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:54.999751 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-4f9e27b2-e9fd-434d-b473-d2d0221dc920 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:55.009923 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 161/324] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:22:54 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:22:55.014805 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-384802d5-6584-4e2c-8351-017a7a04e20f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:55.015416 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-384802d5-6584-4e2c-8351-017a7a04e20f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 867f3a7b-7e7e-468a-b1a3-9c71cc196f23] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:55.030474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-384802d5-6584-4e2c-8351-017a7a04e20f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:55.031054 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-384802d5-6584-4e2c-8351-017a7a04e20f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:55.032032 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-384802d5-6584-4e2c-8351-017a7a04e20f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:55.033347 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-384802d5-6584-4e2c-8351-017a7a04e20f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:55.066535 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-4f9e27b2-e9fd-434d-b473-d2d0221dc920 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:55.074047 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-4f9e27b2-e9fd-434d-b473-d2d0221dc920 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1245 microversion: 2.1 time: 0.080112 May 25 16:22:55.083752 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 164/325] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:54 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:55.089426 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-41638359-9a0e-4b09-8ecc-132e3d648ce4 req-9d0f03d2-e208-434b-a2ff-f2014c619356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "867f3a7b-7e7e-468a-b1a3-9c71cc196f23", "name": "network-vif-plugged", "status": "completed", "tag": "6671911c-5350-4820-bfd8-8e86bc7f1151"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:22:55.098012 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-41638359-9a0e-4b09-8ecc-132e3d648ce4 req-9d0f03d2-e208-434b-a2ff-f2014c619356 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:55.098542 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-41638359-9a0e-4b09-8ecc-132e3d648ce4 req-9d0f03d2-e208-434b-a2ff-f2014c619356 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:55.110730 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-41638359-9a0e-4b09-8ecc-132e3d648ce4 req-9d0f03d2-e208-434b-a2ff-f2014c619356 service nova] Creating event network-vif-plugged:6671911c-5350-4820-bfd8-8e86bc7f1151 for instance 867f3a7b-7e7e-468a-b1a3-9c71cc196f23 on hv-cinder-84327 May 25 16:22:55.115540 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-41638359-9a0e-4b09-8ecc-132e3d648ce4 req-9d0f03d2-e208-434b-a2ff-f2014c619356 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030400 May 25 16:22:55.116940 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 165/326] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:22:55.174237 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-384802d5-6584-4e2c-8351-017a7a04e20f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:55.182393 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-384802d5-6584-4e2c-8351-017a7a04e20f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23" status: 200 len: 1367 microversion: 2.1 time: 0.171315 May 25 16:22:55.182974 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 162/327] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:55 2022] GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:55.575856 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-df4f19d1-fadf-42ac-81a3-a5d0bde9afe4 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:55.576806 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-df4f19d1-fadf-42ac-81a3-a5d0bde9afe4 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:55.582919 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-df4f19d1-fadf-42ac-81a3-a5d0bde9afe4 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:55.583365 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-df4f19d1-fadf-42ac-81a3-a5d0bde9afe4 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:55.584108 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-df4f19d1-fadf-42ac-81a3-a5d0bde9afe4 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:55.584537 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-df4f19d1-fadf-42ac-81a3-a5d0bde9afe4 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:55.716525 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-df4f19d1-fadf-42ac-81a3-a5d0bde9afe4 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:55.725382 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-df4f19d1-fadf-42ac-81a3-a5d0bde9afe4 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760" status: 200 len: 1267 microversion: 2.1 time: 0.153611 May 25 16:22:55.726509 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 166/328] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:55 2022] GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:56.003989 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-09c3bf17-a0de-4b88-a4bf-957b58ed3b3a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:56.003989 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-09c3bf17-a0de-4b88-a4bf-957b58ed3b3a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:56.006668 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-09c3bf17-a0de-4b88-a4bf-957b58ed3b3a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:56.007191 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-09c3bf17-a0de-4b88-a4bf-957b58ed3b3a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:56.008100 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-09c3bf17-a0de-4b88-a4bf-957b58ed3b3a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:56.008549 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-09c3bf17-a0de-4b88-a4bf-957b58ed3b3a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:56.016323 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-bdbe59ca-3104-4c4f-80bc-f9636262bff8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:56.017225 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-bdbe59ca-3104-4c4f-80bc-f9636262bff8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:56.023961 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-bdbe59ca-3104-4c4f-80bc-f9636262bff8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:56.024473 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-bdbe59ca-3104-4c4f-80bc-f9636262bff8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:56.025301 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-bdbe59ca-3104-4c4f-80bc-f9636262bff8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:56.025971 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-bdbe59ca-3104-4c4f-80bc-f9636262bff8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:56.219655 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-09c3bf17-a0de-4b88-a4bf-957b58ed3b3a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:56.227711 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-09c3bf17-a0de-4b88-a4bf-957b58ed3b3a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1723 microversion: 2.1 time: 0.231982 May 25 16:22:56.229070 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 163/329] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:55 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:56.233439 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-bdbe59ca-3104-4c4f-80bc-f9636262bff8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:56.234380 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-c31443a4-b0bd-4fc3-bb26-c9f5b3fcd573 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:56.235194 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-c31443a4-b0bd-4fc3-bb26-c9f5b3fcd573 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:56.243381 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c31443a4-b0bd-4fc3-bb26-c9f5b3fcd573 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:56.243958 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c31443a4-b0bd-4fc3-bb26-c9f5b3fcd573 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:56.244621 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-bdbe59ca-3104-4c4f-80bc-f9636262bff8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:56.244773 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c31443a4-b0bd-4fc3-bb26-c9f5b3fcd573 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:56.245566 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c31443a4-b0bd-4fc3-bb26-c9f5b3fcd573 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:56.246383 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-bdbe59ca-3104-4c4f-80bc-f9636262bff8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:56.247709 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-bdbe59ca-3104-4c4f-80bc-f9636262bff8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1722 microversion: 2.20 time: 0.235301 May 25 16:22:56.248518 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 167/330] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:22:56 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:22:56.253502 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-399219d7-561a-447e-be28-7110501509fb tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:56.254130 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-399219d7-561a-447e-be28-7110501509fb tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 867f3a7b-7e7e-468a-b1a3-9c71cc196f23] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:56.261164 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-399219d7-561a-447e-be28-7110501509fb tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:56.261614 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-399219d7-561a-447e-be28-7110501509fb tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:56.262409 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-399219d7-561a-447e-be28-7110501509fb tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:56.262849 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-399219d7-561a-447e-be28-7110501509fb tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:56.321474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-c31443a4-b0bd-4fc3-bb26-c9f5b3fcd573 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:56.329593 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-c31443a4-b0bd-4fc3-bb26-c9f5b3fcd573 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1241 microversion: 2.1 time: 0.099165 May 25 16:22:56.337639 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 164/331] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:56 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1241 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:56.419836 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-399219d7-561a-447e-be28-7110501509fb tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:56.428178 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-399219d7-561a-447e-be28-7110501509fb tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23" status: 200 len: 1367 microversion: 2.1 time: 0.178514 May 25 16:22:56.429498 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 168/332] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:56 2022] GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:56.743322 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-6ba02014-ecc1-44d3-adc0-0d52d2c4ff2c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:56.743929 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-6ba02014-ecc1-44d3-adc0-0d52d2c4ff2c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:56.749918 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6ba02014-ecc1-44d3-adc0-0d52d2c4ff2c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:56.750372 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6ba02014-ecc1-44d3-adc0-0d52d2c4ff2c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:56.751163 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6ba02014-ecc1-44d3-adc0-0d52d2c4ff2c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:56.751599 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6ba02014-ecc1-44d3-adc0-0d52d2c4ff2c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:56.888154 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-6ba02014-ecc1-44d3-adc0-0d52d2c4ff2c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:56.898158 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-6ba02014-ecc1-44d3-adc0-0d52d2c4ff2c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760" status: 200 len: 1267 microversion: 2.1 time: 0.158691 May 25 16:22:56.898953 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 165/333] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:56 2022] GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:57.246148 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-51078873-1ce0-4198-90d6-fb266e2ed9ee tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:57.246781 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-51078873-1ce0-4198-90d6-fb266e2ed9ee tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:57.252858 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-51078873-1ce0-4198-90d6-fb266e2ed9ee tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:57.253301 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-51078873-1ce0-4198-90d6-fb266e2ed9ee tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:57.254088 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-51078873-1ce0-4198-90d6-fb266e2ed9ee tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:57.254517 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-51078873-1ce0-4198-90d6-fb266e2ed9ee tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:57.267527 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-f03005bc-b377-423d-8f47-f7e7ddd193a0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:57.268154 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-f03005bc-b377-423d-8f47-f7e7ddd193a0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:57.274734 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f03005bc-b377-423d-8f47-f7e7ddd193a0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:57.275183 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f03005bc-b377-423d-8f47-f7e7ddd193a0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:57.277119 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f03005bc-b377-423d-8f47-f7e7ddd193a0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:57.277579 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f03005bc-b377-423d-8f47-f7e7ddd193a0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:57.465219 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-51078873-1ce0-4198-90d6-fb266e2ed9ee tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:57.472497 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-f03005bc-b377-423d-8f47-f7e7ddd193a0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:57.478683 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-51078873-1ce0-4198-90d6-fb266e2ed9ee tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1723 microversion: 2.1 time: 0.236456 May 25 16:22:57.479260 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 169/334] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:57 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:57.492820 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-66894725-9570-4e82-89d9-c519a3994343 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:57.493459 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-66894725-9570-4e82-89d9-c519a3994343 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:57.497331 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-f03005bc-b377-423d-8f47-f7e7ddd193a0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:57.498916 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-f03005bc-b377-423d-8f47-f7e7ddd193a0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:57.500101 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-f03005bc-b377-423d-8f47-f7e7ddd193a0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1722 microversion: 2.20 time: 0.236407 May 25 16:22:57.500652 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 166/335] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:22:57 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:22:57.506542 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-8b055af7-fec3-4a84-8cee-a215dbfa9798 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:57.510921 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-66894725-9570-4e82-89d9-c519a3994343 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:57.511557 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-66894725-9570-4e82-89d9-c519a3994343 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:57.512503 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-66894725-9570-4e82-89d9-c519a3994343 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:57.513087 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-66894725-9570-4e82-89d9-c519a3994343 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:57.514011 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-8b055af7-fec3-4a84-8cee-a215dbfa9798 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 867f3a7b-7e7e-468a-b1a3-9c71cc196f23] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:57.528145 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8b055af7-fec3-4a84-8cee-a215dbfa9798 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:57.528593 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8b055af7-fec3-4a84-8cee-a215dbfa9798 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:57.529877 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8b055af7-fec3-4a84-8cee-a215dbfa9798 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:57.532733 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8b055af7-fec3-4a84-8cee-a215dbfa9798 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:57.606716 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-66894725-9570-4e82-89d9-c519a3994343 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:57.617009 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-66894725-9570-4e82-89d9-c519a3994343 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1297 microversion: 2.1 time: 0.133430 May 25 16:22:57.617582 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 170/336] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:57 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1297 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:57.736114 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-8b055af7-fec3-4a84-8cee-a215dbfa9798 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:57.744857 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-8b055af7-fec3-4a84-8cee-a215dbfa9798 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23" status: 200 len: 1367 microversion: 2.1 time: 0.241698 May 25 16:22:57.745789 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 167/337] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:57 2022] GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:57.914820 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-4197e20e-989b-4200-9e62-459167fc0051 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:57.915624 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-4197e20e-989b-4200-9e62-459167fc0051 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:57.921931 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4197e20e-989b-4200-9e62-459167fc0051 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:57.922378 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4197e20e-989b-4200-9e62-459167fc0051 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:57.923134 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4197e20e-989b-4200-9e62-459167fc0051 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:57.923567 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4197e20e-989b-4200-9e62-459167fc0051 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:58.069581 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-4197e20e-989b-4200-9e62-459167fc0051 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:58.079492 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-4197e20e-989b-4200-9e62-459167fc0051 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760" status: 200 len: 1267 microversion: 2.1 time: 0.168614 May 25 16:22:58.090982 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 171/338] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:57 2022] GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:58.496252 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-c3188833-4e2c-4373-a42d-66139ed73c42 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:58.496988 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-c3188833-4e2c-4373-a42d-66139ed73c42 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:58.507093 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c3188833-4e2c-4373-a42d-66139ed73c42 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:58.508918 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c3188833-4e2c-4373-a42d-66139ed73c42 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:58.510976 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c3188833-4e2c-4373-a42d-66139ed73c42 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:58.511754 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c3188833-4e2c-4373-a42d-66139ed73c42 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:58.517757 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-ac848b50-45d6-4c22-8955-a7234a4e19cd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:58.518371 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-ac848b50-45d6-4c22-8955-a7234a4e19cd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:58.526902 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ac848b50-45d6-4c22-8955-a7234a4e19cd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:58.527355 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ac848b50-45d6-4c22-8955-a7234a4e19cd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:58.528713 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ac848b50-45d6-4c22-8955-a7234a4e19cd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:58.528713 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ac848b50-45d6-4c22-8955-a7234a4e19cd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:58.794842 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-ac848b50-45d6-4c22-8955-a7234a4e19cd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:58.803963 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-ac848b50-45d6-4c22-8955-a7234a4e19cd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:58.805569 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-ac848b50-45d6-4c22-8955-a7234a4e19cd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:58.806765 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-ac848b50-45d6-4c22-8955-a7234a4e19cd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1722 microversion: 2.20 time: 0.292837 May 25 16:22:58.807318 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 172/339] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:22:58 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1722 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:22:58.813872 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-c3188833-4e2c-4373-a42d-66139ed73c42 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:58.824029 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-c3188833-4e2c-4373-a42d-66139ed73c42 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1723 microversion: 2.1 time: 0.331307 May 25 16:22:58.831628 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 168/340] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:58 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1723 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:58.833647 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-c5c046ec-f19d-42b8-9e85-4a9659ef3b29 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:58.834536 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-c5c046ec-f19d-42b8-9e85-4a9659ef3b29 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:58.842240 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c5c046ec-f19d-42b8-9e85-4a9659ef3b29 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:58.847050 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-ce5b3b89-aabc-4aec-9341-64602215fef2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:58.847875 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-ce5b3b89-aabc-4aec-9341-64602215fef2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 867f3a7b-7e7e-468a-b1a3-9c71cc196f23] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:58.857646 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c5c046ec-f19d-42b8-9e85-4a9659ef3b29 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:58.858553 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c5c046ec-f19d-42b8-9e85-4a9659ef3b29 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:58.859022 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c5c046ec-f19d-42b8-9e85-4a9659ef3b29 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:58.862223 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ce5b3b89-aabc-4aec-9341-64602215fef2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:58.862739 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ce5b3b89-aabc-4aec-9341-64602215fef2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:58.863779 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ce5b3b89-aabc-4aec-9341-64602215fef2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:58.863970 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ce5b3b89-aabc-4aec-9341-64602215fef2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:58.914354 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:22:59.075984 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-ce5b3b89-aabc-4aec-9341-64602215fef2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:59.088282 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-ce5b3b89-aabc-4aec-9341-64602215fef2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23" status: 200 len: 1557 microversion: 2.1 time: 0.254841 May 25 16:22:59.102512 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 169/341] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:58 2022] GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23 => generated 1557 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:59.109136 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-777423aa-53cb-4811-a8af-9bb75b932e6c req-4d2a3d35-4ab7-44ad-a8b7-5d941f9c69c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2ffa3b0-9de0-483c-86b7-0f18718d8760", "name": "network-vif-plugged", "status": "completed", "tag": "b584eb77-9528-491e-9943-03658d935cdc"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:22:59.119145 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-777423aa-53cb-4811-a8af-9bb75b932e6c req-4d2a3d35-4ab7-44ad-a8b7-5d941f9c69c3 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:59.119915 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-777423aa-53cb-4811-a8af-9bb75b932e6c req-4d2a3d35-4ab7-44ad-a8b7-5d941f9c69c3 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:59.135222 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-777423aa-53cb-4811-a8af-9bb75b932e6c req-4d2a3d35-4ab7-44ad-a8b7-5d941f9c69c3 service nova] Creating event network-vif-plugged:b584eb77-9528-491e-9943-03658d935cdc for instance c2ffa3b0-9de0-483c-86b7-0f18718d8760 on hv-cinder-84327 May 25 16:22:59.135430 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-c5c046ec-f19d-42b8-9e85-4a9659ef3b29 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:59.140552 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-777423aa-53cb-4811-a8af-9bb75b932e6c req-4d2a3d35-4ab7-44ad-a8b7-5d941f9c69c3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036340 May 25 16:22:59.141388 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 170/342] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:22:59.146661 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-99764719-e8e6-4b9d-9e30-75c4f1b15141 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:59.147393 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-99764719-e8e6-4b9d-9e30-75c4f1b15141 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:59.148363 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-c5c046ec-f19d-42b8-9e85-4a9659ef3b29 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1370 microversion: 2.1 time: 0.322307 May 25 16:22:59.149171 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 173/343] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:58 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1370 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:59.153833 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-99764719-e8e6-4b9d-9e30-75c4f1b15141 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:59.154206 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-839e35f4-abe3-4dbf-b76f-bc2fa7a21372 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:59.154649 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-99764719-e8e6-4b9d-9e30-75c4f1b15141 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:59.154780 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-839e35f4-abe3-4dbf-b76f-bc2fa7a21372 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 867f3a7b-7e7e-468a-b1a3-9c71cc196f23] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:59.155741 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-99764719-e8e6-4b9d-9e30-75c4f1b15141 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:59.156382 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-99764719-e8e6-4b9d-9e30-75c4f1b15141 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:59.176034 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-839e35f4-abe3-4dbf-b76f-bc2fa7a21372 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:59.176532 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-839e35f4-abe3-4dbf-b76f-bc2fa7a21372 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:59.177437 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-839e35f4-abe3-4dbf-b76f-bc2fa7a21372 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:59.178086 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-839e35f4-abe3-4dbf-b76f-bc2fa7a21372 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:59.296313 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-839e35f4-abe3-4dbf-b76f-bc2fa7a21372 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.145882 May 25 16:22:59.297620 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 174/344] 10.222.0.42 () {58 vars in 1274 bytes} [Wed May 25 16:22:59 2022] GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:22:59.465911 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-99764719-e8e6-4b9d-9e30-75c4f1b15141 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:22:59.473338 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-99764719-e8e6-4b9d-9e30-75c4f1b15141 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760" status: 200 len: 1267 microversion: 2.1 time: 0.330540 May 25 16:22:59.484187 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 171/345] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:59 2022] GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 => generated 1267 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:22:59.824906 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-859427e0-e659-4574-945d-df46cb7122c5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:59.825624 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-859427e0-e659-4574-945d-df46cb7122c5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:59.840735 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-859427e0-e659-4574-945d-df46cb7122c5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:59.841936 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-859427e0-e659-4574-945d-df46cb7122c5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:59.842884 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-859427e0-e659-4574-945d-df46cb7122c5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:59.843606 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-859427e0-e659-4574-945d-df46cb7122c5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:59.852931 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-bf64da26-51c4-4306-ab99-e7333ad2a607 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:22:59.855099 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-bf64da26-51c4-4306-ab99-e7333ad2a607 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:22:59.872990 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-bf64da26-51c4-4306-ab99-e7333ad2a607 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:59.873362 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-bf64da26-51c4-4306-ab99-e7333ad2a607 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:22:59.878900 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-bf64da26-51c4-4306-ab99-e7333ad2a607 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:22:59.879372 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-bf64da26-51c4-4306-ab99-e7333ad2a607 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:00.146349 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-859427e0-e659-4574-945d-df46cb7122c5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:00.160854 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-859427e0-e659-4574-945d-df46cb7122c5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:00.162698 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-859427e0-e659-4574-945d-df46cb7122c5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:00.164185 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-859427e0-e659-4574-945d-df46cb7122c5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1722 microversion: 2.20 time: 0.343679 May 25 16:23:00.165205 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 175/346] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:22:59 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1722 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:00.170972 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-d887e6de-4b92-4651-b4e1-4d022fae00da req-085385af-02b3-4649-8fa8-dfbf3490d76d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f68f3730-3984-4aef-9c58-e87b09051c87", "tag": "1b194465-a3bb-473d-8825-aed33ba4c44a"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:23:00.182040 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-d887e6de-4b92-4651-b4e1-4d022fae00da req-085385af-02b3-4649-8fa8-dfbf3490d76d service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:00.182578 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-d887e6de-4b92-4651-b4e1-4d022fae00da req-085385af-02b3-4649-8fa8-dfbf3490d76d service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:00.187838 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-bf64da26-51c4-4306-ab99-e7333ad2a607 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:00.199215 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-bf64da26-51c4-4306-ab99-e7333ad2a607 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1723 microversion: 2.1 time: 0.353300 May 25 16:23:00.199808 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 172/347] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:22:59 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1723 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:23:00.227864 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-ced4ece1-ba73-4584-ad56-9818717d5282 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:00.229778 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-ced4ece1-ba73-4584-ad56-9818717d5282 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:00.242088 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-d887e6de-4b92-4651-b4e1-4d022fae00da req-085385af-02b3-4649-8fa8-dfbf3490d76d service nova] Creating event network-changed:1b194465-a3bb-473d-8825-aed33ba4c44a for instance f68f3730-3984-4aef-9c58-e87b09051c87 on hv-cinder-84327 May 25 16:23:00.248244 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ced4ece1-ba73-4584-ad56-9818717d5282 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:00.248854 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ced4ece1-ba73-4584-ad56-9818717d5282 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:00.249737 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ced4ece1-ba73-4584-ad56-9818717d5282 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:00.252128 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-d887e6de-4b92-4651-b4e1-4d022fae00da req-085385af-02b3-4649-8fa8-dfbf3490d76d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085127 May 25 16:23:00.253596 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 176/348] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:23:00.254596 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ced4ece1-ba73-4584-ad56-9818717d5282 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:00.492419 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-dcab11d4-d81d-431a-9337-da72168b2b5d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:00.494681 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-dcab11d4-d81d-431a-9337-da72168b2b5d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:00.497893 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-ced4ece1-ba73-4584-ad56-9818717d5282 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:00.512515 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dcab11d4-d81d-431a-9337-da72168b2b5d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:00.516853 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-ced4ece1-ba73-4584-ad56-9818717d5282 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1370 microversion: 2.1 time: 0.316023 May 25 16:23:00.517438 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dcab11d4-d81d-431a-9337-da72168b2b5d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:00.518307 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dcab11d4-d81d-431a-9337-da72168b2b5d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:00.518881 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dcab11d4-d81d-431a-9337-da72168b2b5d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:00.525091 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 173/349] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:23:00 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1370 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:00.793999 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-dcab11d4-d81d-431a-9337-da72168b2b5d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:00.808645 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-dcab11d4-d81d-431a-9337-da72168b2b5d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760" status: 200 len: 1267 microversion: 2.1 time: 0.320768 May 25 16:23:00.809444 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 177/350] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:23:00 2022] GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 => generated 1267 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:01.153661 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-a6b2ef53-1817-4408-ba0e-690ffd803fbb req-f9b10d30-99e9-4b63-9930-2d22c3de08cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "867f3a7b-7e7e-468a-b1a3-9c71cc196f23", "tag": "6671911c-5350-4820-bfd8-8e86bc7f1151"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:23:01.157845 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:23:01.192100 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-e6dfea09-cd28-491c-9778-6d32fe06c1d4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:01.192715 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-e6dfea09-cd28-491c-9778-6d32fe06c1d4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:01.202130 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e6dfea09-cd28-491c-9778-6d32fe06c1d4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:01.203225 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e6dfea09-cd28-491c-9778-6d32fe06c1d4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:01.204811 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e6dfea09-cd28-491c-9778-6d32fe06c1d4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:01.205441 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e6dfea09-cd28-491c-9778-6d32fe06c1d4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:01.206947 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-a6b2ef53-1817-4408-ba0e-690ffd803fbb req-f9b10d30-99e9-4b63-9930-2d22c3de08cc service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:01.207652 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-a6b2ef53-1817-4408-ba0e-690ffd803fbb req-f9b10d30-99e9-4b63-9930-2d22c3de08cc service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:01.218210 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=100 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:23:01.229983 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-a6b2ef53-1817-4408-ba0e-690ffd803fbb req-f9b10d30-99e9-4b63-9930-2d22c3de08cc service nova] Creating event network-changed:6671911c-5350-4820-bfd8-8e86bc7f1151 for instance 867f3a7b-7e7e-468a-b1a3-9c71cc196f23 on hv-cinder-84327 May 25 16:23:01.235951 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-a6b2ef53-1817-4408-ba0e-690ffd803fbb req-f9b10d30-99e9-4b63-9930-2d22c3de08cc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086267 May 25 16:23:01.237973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 174/351] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:23:01.245811 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-95355d4d-4814-4f6d-ad8a-b84f6b41ab60 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:01.246959 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-95355d4d-4814-4f6d-ad8a-b84f6b41ab60 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:01.254276 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-95355d4d-4814-4f6d-ad8a-b84f6b41ab60 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:01.255072 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-95355d4d-4814-4f6d-ad8a-b84f6b41ab60 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:01.256198 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-95355d4d-4814-4f6d-ad8a-b84f6b41ab60 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:01.256865 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-95355d4d-4814-4f6d-ad8a-b84f6b41ab60 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:01.482899 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-e6dfea09-cd28-491c-9778-6d32fe06c1d4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:01.492388 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-e6dfea09-cd28-491c-9778-6d32fe06c1d4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:01.493968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-e6dfea09-cd28-491c-9778-6d32fe06c1d4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:01.494846 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-95355d4d-4814-4f6d-ad8a-b84f6b41ab60 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:01.495720 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-e6dfea09-cd28-491c-9778-6d32fe06c1d4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1722 microversion: 2.20 time: 0.317045 May 25 16:23:01.496498 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 178/352] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:01 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1722 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:23:01.505158 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-95355d4d-4814-4f6d-ad8a-b84f6b41ab60 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1723 microversion: 2.1 time: 0.265259 May 25 16:23:01.506096 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 175/353] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:23:01 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:01.544878 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-dcf34d9b-b400-44a8-a20d-df33f77c9f97 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:01.546077 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-dcf34d9b-b400-44a8-a20d-df33f77c9f97 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:01.552457 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dcf34d9b-b400-44a8-a20d-df33f77c9f97 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:01.552900 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dcf34d9b-b400-44a8-a20d-df33f77c9f97 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:01.553904 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dcf34d9b-b400-44a8-a20d-df33f77c9f97 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:01.554456 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dcf34d9b-b400-44a8-a20d-df33f77c9f97 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:01.690468 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-dcf34d9b-b400-44a8-a20d-df33f77c9f97 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:01.699164 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-dcf34d9b-b400-44a8-a20d-df33f77c9f97 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1370 microversion: 2.1 time: 0.158963 May 25 16:23:01.699967 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 179/354] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:23:01 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:01.825033 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-3d066367-305c-4027-ad63-374e010a546a tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:01.825590 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-3d066367-305c-4027-ad63-374e010a546a tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:01.831559 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3d066367-305c-4027-ad63-374e010a546a tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:01.832008 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3d066367-305c-4027-ad63-374e010a546a tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:01.832771 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3d066367-305c-4027-ad63-374e010a546a tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:01.833212 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3d066367-305c-4027-ad63-374e010a546a tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:01.976733 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-3d066367-305c-4027-ad63-374e010a546a tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:01.984191 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-3d066367-305c-4027-ad63-374e010a546a tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760" status: 200 len: 1267 microversion: 2.1 time: 0.163118 May 25 16:23:01.984955 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 176/355] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:23:01 2022] GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:02.515102 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-d5905bb2-b5b3-4c1a-9ea5-20f5c80d631d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:02.522973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-cabea6e5-4448-46e8-9ee7-04f990ac3b4e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:02.523679 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-cabea6e5-4448-46e8-9ee7-04f990ac3b4e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:02.526633 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-d5905bb2-b5b3-4c1a-9ea5-20f5c80d631d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:02.534242 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d5905bb2-b5b3-4c1a-9ea5-20f5c80d631d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:02.534776 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d5905bb2-b5b3-4c1a-9ea5-20f5c80d631d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:02.535094 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-cabea6e5-4448-46e8-9ee7-04f990ac3b4e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:02.535636 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d5905bb2-b5b3-4c1a-9ea5-20f5c80d631d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:02.535764 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-cabea6e5-4448-46e8-9ee7-04f990ac3b4e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:02.536083 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d5905bb2-b5b3-4c1a-9ea5-20f5c80d631d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:02.536708 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-cabea6e5-4448-46e8-9ee7-04f990ac3b4e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:02.537283 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-cabea6e5-4448-46e8-9ee7-04f990ac3b4e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:02.737147 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-d5905bb2-b5b3-4c1a-9ea5-20f5c80d631d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:02.744425 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-cabea6e5-4448-46e8-9ee7-04f990ac3b4e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:02.746815 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-d5905bb2-b5b3-4c1a-9ea5-20f5c80d631d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:02.748353 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-d5905bb2-b5b3-4c1a-9ea5-20f5c80d631d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:02.749516 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-d5905bb2-b5b3-4c1a-9ea5-20f5c80d631d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1722 microversion: 2.20 time: 0.239245 May 25 16:23:02.750269 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 180/356] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:02 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:02.752233 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-cabea6e5-4448-46e8-9ee7-04f990ac3b4e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1723 microversion: 2.1 time: 0.233883 May 25 16:23:02.752969 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 177/357] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:23:02 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:02.764172 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-dafa0db9-a01f-4832-95fe-e965f804beab tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:02.764784 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-dafa0db9-a01f-4832-95fe-e965f804beab tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:02.771102 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dafa0db9-a01f-4832-95fe-e965f804beab tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:02.771557 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dafa0db9-a01f-4832-95fe-e965f804beab tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:02.772488 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dafa0db9-a01f-4832-95fe-e965f804beab tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:02.772972 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dafa0db9-a01f-4832-95fe-e965f804beab tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:02.907904 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-dafa0db9-a01f-4832-95fe-e965f804beab tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:02.916694 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-dafa0db9-a01f-4832-95fe-e965f804beab tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1370 microversion: 2.1 time: 0.165214 May 25 16:23:02.917651 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 181/358] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:23:02 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:03.001283 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-df02c5cb-552b-4897-b222-bbc7ec3c801d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:03.001923 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-df02c5cb-552b-4897-b222-bbc7ec3c801d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:03.008466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-df02c5cb-552b-4897-b222-bbc7ec3c801d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:03.008907 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-df02c5cb-552b-4897-b222-bbc7ec3c801d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:03.009662 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-df02c5cb-552b-4897-b222-bbc7ec3c801d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:03.010393 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-df02c5cb-552b-4897-b222-bbc7ec3c801d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:03.148726 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-df02c5cb-552b-4897-b222-bbc7ec3c801d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:03.157960 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-df02c5cb-552b-4897-b222-bbc7ec3c801d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760" status: 200 len: 1267 microversion: 2.1 time: 0.160354 May 25 16:23:03.158887 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 178/359] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:23:02 2022] GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:03.768362 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-7a155bc8-2781-4876-986f-0324c9d38563 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:03.768881 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-0cf22657-0e80-4441-b157-07464769a554 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:03.769257 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-7a155bc8-2781-4876-986f-0324c9d38563 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:03.769351 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-0cf22657-0e80-4441-b157-07464769a554 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:03.775953 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7a155bc8-2781-4876-986f-0324c9d38563 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:03.776411 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7a155bc8-2781-4876-986f-0324c9d38563 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:03.776993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0cf22657-0e80-4441-b157-07464769a554 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:03.777179 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7a155bc8-2781-4876-986f-0324c9d38563 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:03.777429 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0cf22657-0e80-4441-b157-07464769a554 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:03.777619 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7a155bc8-2781-4876-986f-0324c9d38563 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:03.778222 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0cf22657-0e80-4441-b157-07464769a554 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:03.778662 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0cf22657-0e80-4441-b157-07464769a554 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:03.987072 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-7a155bc8-2781-4876-986f-0324c9d38563 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:03.991781 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-0cf22657-0e80-4441-b157-07464769a554 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:03.995566 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-7a155bc8-2781-4876-986f-0324c9d38563 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:03.997151 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-7a155bc8-2781-4876-986f-0324c9d38563 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:03.998318 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-7a155bc8-2781-4876-986f-0324c9d38563 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1722 microversion: 2.20 time: 0.234043 May 25 16:23:03.998882 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 182/360] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:03 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:03.999719 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-0cf22657-0e80-4441-b157-07464769a554 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1723 microversion: 2.1 time: 0.234758 May 25 16:23:04.000406 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 179/361] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:23:03 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:23:04.003251 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-480e7361-df24-48eb-91fa-d01fce77415a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:04.003848 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-480e7361-df24-48eb-91fa-d01fce77415a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:04.010262 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-480e7361-df24-48eb-91fa-d01fce77415a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:04.010706 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-480e7361-df24-48eb-91fa-d01fce77415a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:04.012098 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-480e7361-df24-48eb-91fa-d01fce77415a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:04.012541 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-480e7361-df24-48eb-91fa-d01fce77415a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:04.145054 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-480e7361-df24-48eb-91fa-d01fce77415a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:04.152537 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-480e7361-df24-48eb-91fa-d01fce77415a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1370 microversion: 2.1 time: 0.152722 May 25 16:23:04.153097 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 183/362] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:23:03 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:04.174814 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-6b181571-0b5d-4fdb-baea-de8147b3cc36 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:04.175425 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-6b181571-0b5d-4fdb-baea-de8147b3cc36 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:04.182734 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6b181571-0b5d-4fdb-baea-de8147b3cc36 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:04.183192 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6b181571-0b5d-4fdb-baea-de8147b3cc36 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:04.183966 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6b181571-0b5d-4fdb-baea-de8147b3cc36 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:04.184408 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6b181571-0b5d-4fdb-baea-de8147b3cc36 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:04.323486 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-6b181571-0b5d-4fdb-baea-de8147b3cc36 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:04.331043 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-6b181571-0b5d-4fdb-baea-de8147b3cc36 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760" status: 200 len: 1453 microversion: 2.1 time: 0.160021 May 25 16:23:04.331609 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 180/363] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:23:04 2022] GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:04.349179 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-4805d3ce-4290-4bda-b540-a09c259c51f7 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:04.349704 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-4805d3ce-4290-4bda-b540-a09c259c51f7 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:04.356037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4805d3ce-4290-4bda-b540-a09c259c51f7 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:04.356490 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4805d3ce-4290-4bda-b540-a09c259c51f7 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:04.357242 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4805d3ce-4290-4bda-b540-a09c259c51f7 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:04.357674 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4805d3ce-4290-4bda-b540-a09c259c51f7 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:04.493665 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-4805d3ce-4290-4bda-b540-a09c259c51f7 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:04.501300 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-4805d3ce-4290-4bda-b540-a09c259c51f7 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760" status: 200 len: 1453 microversion: 2.1 time: 0.156170 May 25 16:23:04.502091 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 184/364] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:23:04 2022] GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:05.014047 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-01eb579f-dc9d-4a4f-97f2-5abf48564008 req-6bd108e4-4e00-4a4a-a6bc-7c7070166d78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f68f3730-3984-4aef-9c58-e87b09051c87", "name": "network-vif-plugged", "status": "completed", "tag": "1b194465-a3bb-473d-8825-aed33ba4c44a"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:23:05.017843 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-2c91f225-cfa1-4e28-9a11-1b02f0c1c42d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:05.018520 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-2c91f225-cfa1-4e28-9a11-1b02f0c1c42d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:05.020965 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell0:SELECT=2 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:23:05.022901 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell0:SELECT=10 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:23:05.028112 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2c91f225-cfa1-4e28-9a11-1b02f0c1c42d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:05.029006 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2c91f225-cfa1-4e28-9a11-1b02f0c1c42d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:05.030385 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2c91f225-cfa1-4e28-9a11-1b02f0c1c42d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:05.031108 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2c91f225-cfa1-4e28-9a11-1b02f0c1c42d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:05.038462 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-01eb579f-dc9d-4a4f-97f2-5abf48564008 req-6bd108e4-4e00-4a4a-a6bc-7c7070166d78 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:05.039196 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-01eb579f-dc9d-4a4f-97f2-5abf48564008 req-6bd108e4-4e00-4a4a-a6bc-7c7070166d78 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:05.054219 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-01eb579f-dc9d-4a4f-97f2-5abf48564008 req-6bd108e4-4e00-4a4a-a6bc-7c7070166d78 service nova] Creating event network-vif-plugged:1b194465-a3bb-473d-8825-aed33ba4c44a for instance f68f3730-3984-4aef-9c58-e87b09051c87 on hv-cinder-84327 May 25 16:23:05.060908 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-01eb579f-dc9d-4a4f-97f2-5abf48564008 req-6bd108e4-4e00-4a4a-a6bc-7c7070166d78 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050440 May 25 16:23:05.063936 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 181/365] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:23:05.077173 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-a06f764b-99a4-45e5-a911-8c55cb8f6c88 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:05.078651 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-a06f764b-99a4-45e5-a911-8c55cb8f6c88 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:05.088091 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a06f764b-99a4-45e5-a911-8c55cb8f6c88 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:05.088938 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a06f764b-99a4-45e5-a911-8c55cb8f6c88 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:05.093928 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a06f764b-99a4-45e5-a911-8c55cb8f6c88 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:05.094853 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a06f764b-99a4-45e5-a911-8c55cb8f6c88 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:05.102499 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell0:SELECT=2 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:23:05.430429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-2c91f225-cfa1-4e28-9a11-1b02f0c1c42d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:05.451577 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-2c91f225-cfa1-4e28-9a11-1b02f0c1c42d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1723 microversion: 2.1 time: 0.439081 May 25 16:23:05.452163 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 185/366] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:23:05 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1723 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:05.456994 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-dd38a90e-cb53-4377-9ed0-97eb0df0a165 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:05.457519 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-dd38a90e-cb53-4377-9ed0-97eb0df0a165 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:05.460935 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-a06f764b-99a4-45e5-a911-8c55cb8f6c88 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:05.464890 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dd38a90e-cb53-4377-9ed0-97eb0df0a165 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:05.465577 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dd38a90e-cb53-4377-9ed0-97eb0df0a165 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:05.466387 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dd38a90e-cb53-4377-9ed0-97eb0df0a165 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:05.466822 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dd38a90e-cb53-4377-9ed0-97eb0df0a165 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:05.470590 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-a06f764b-99a4-45e5-a911-8c55cb8f6c88 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:05.472233 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-a06f764b-99a4-45e5-a911-8c55cb8f6c88 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:05.473663 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-a06f764b-99a4-45e5-a911-8c55cb8f6c88 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1743 microversion: 2.20 time: 0.406520 May 25 16:23:05.479022 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 182/367] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:05 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1743 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:05.693850 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-dd38a90e-cb53-4377-9ed0-97eb0df0a165 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:05.702239 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-dd38a90e-cb53-4377-9ed0-97eb0df0a165 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1370 microversion: 2.1 time: 0.248991 May 25 16:23:05.702824 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 186/368] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:23:05 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1370 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:06.468639 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-888a3884-7631-4072-8dc4-12790385dbbd tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:06.469270 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-888a3884-7631-4072-8dc4-12790385dbbd tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:06.476757 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-888a3884-7631-4072-8dc4-12790385dbbd tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:06.477294 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-888a3884-7631-4072-8dc4-12790385dbbd tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:06.478175 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-888a3884-7631-4072-8dc4-12790385dbbd tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:06.478720 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-888a3884-7631-4072-8dc4-12790385dbbd tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:06.496838 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-80b45ac5-0268-4704-8e9a-bbb9e52cd960 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:06.497446 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-80b45ac5-0268-4704-8e9a-bbb9e52cd960 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:06.504573 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-80b45ac5-0268-4704-8e9a-bbb9e52cd960 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:06.506913 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-80b45ac5-0268-4704-8e9a-bbb9e52cd960 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:06.507947 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-80b45ac5-0268-4704-8e9a-bbb9e52cd960 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:06.508704 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-80b45ac5-0268-4704-8e9a-bbb9e52cd960 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:06.750044 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-888a3884-7631-4072-8dc4-12790385dbbd tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:06.758472 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-80b45ac5-0268-4704-8e9a-bbb9e52cd960 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:06.758711 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-888a3884-7631-4072-8dc4-12790385dbbd tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1723 microversion: 2.1 time: 0.294011 May 25 16:23:06.759473 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 183/369] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:23:06 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:06.764355 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-ab0269ad-e685-4070-b307-5567188dacd9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:06.765142 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-ab0269ad-e685-4070-b307-5567188dacd9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:06.767922 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-80b45ac5-0268-4704-8e9a-bbb9e52cd960 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:06.769751 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-80b45ac5-0268-4704-8e9a-bbb9e52cd960 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:06.771107 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ab0269ad-e685-4070-b307-5567188dacd9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:06.771567 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ab0269ad-e685-4070-b307-5567188dacd9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:06.772726 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-80b45ac5-0268-4704-8e9a-bbb9e52cd960 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1743 microversion: 2.20 time: 0.277967 May 25 16:23:06.772917 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ab0269ad-e685-4070-b307-5567188dacd9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:06.773531 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ab0269ad-e685-4070-b307-5567188dacd9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:06.773658 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 187/370] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:06 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1743 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:07.188576 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-ab0269ad-e685-4070-b307-5567188dacd9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:07.197677 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-ab0269ad-e685-4070-b307-5567188dacd9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1370 microversion: 2.1 time: 0.437035 May 25 16:23:07.198368 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 184/371] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:23:06 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1370 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:07.224269 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-0ca8778e-d5d6-49b9-9495-d361cc36577d req-04b2e630-0d69-49e3-b56d-2f55fe42c773 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2ffa3b0-9de0-483c-86b7-0f18718d8760", "tag": "b584eb77-9528-491e-9943-03658d935cdc"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:23:07.233068 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-0ca8778e-d5d6-49b9-9495-d361cc36577d req-04b2e630-0d69-49e3-b56d-2f55fe42c773 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:07.233518 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-0ca8778e-d5d6-49b9-9495-d361cc36577d req-04b2e630-0d69-49e3-b56d-2f55fe42c773 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:07.244940 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-0ca8778e-d5d6-49b9-9495-d361cc36577d req-04b2e630-0d69-49e3-b56d-2f55fe42c773 service nova] Creating event network-changed:b584eb77-9528-491e-9943-03658d935cdc for instance c2ffa3b0-9de0-483c-86b7-0f18718d8760 on hv-cinder-84327 May 25 16:23:07.250002 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-0ca8778e-d5d6-49b9-9495-d361cc36577d req-04b2e630-0d69-49e3-b56d-2f55fe42c773 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029425 May 25 16:23:07.250772 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 188/372] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:23:07.778870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-6de04eb2-db50-476f-83f9-df7a35445486 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:07.780125 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-6de04eb2-db50-476f-83f9-df7a35445486 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:07.795481 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-e917bb10-b66d-4dc8-8446-a798e6096154 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:07.796178 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-e917bb10-b66d-4dc8-8446-a798e6096154 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:07.801954 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6de04eb2-db50-476f-83f9-df7a35445486 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:07.806845 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e917bb10-b66d-4dc8-8446-a798e6096154 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:07.807288 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e917bb10-b66d-4dc8-8446-a798e6096154 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:07.808056 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e917bb10-b66d-4dc8-8446-a798e6096154 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:07.808483 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e917bb10-b66d-4dc8-8446-a798e6096154 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:07.812733 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6de04eb2-db50-476f-83f9-df7a35445486 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:07.813680 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6de04eb2-db50-476f-83f9-df7a35445486 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:07.814148 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6de04eb2-db50-476f-83f9-df7a35445486 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:08.027143 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-6de04eb2-db50-476f-83f9-df7a35445486 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:08.030169 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-e917bb10-b66d-4dc8-8446-a798e6096154 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:08.043158 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-e917bb10-b66d-4dc8-8446-a798e6096154 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:08.044649 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-e917bb10-b66d-4dc8-8446-a798e6096154 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:08.045833 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-e917bb10-b66d-4dc8-8446-a798e6096154 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1743 microversion: 2.20 time: 0.256711 May 25 16:23:08.046538 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 189/373] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:07 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1743 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:08.048555 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-6de04eb2-db50-476f-83f9-df7a35445486 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1723 microversion: 2.1 time: 0.276411 May 25 16:23:08.049150 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 185/374] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:23:07 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1723 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:08.214381 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-a92eacb4-3e96-4792-8fb2-036b65560bd0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:08.215023 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-a92eacb4-3e96-4792-8fb2-036b65560bd0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:08.221087 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a92eacb4-3e96-4792-8fb2-036b65560bd0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:08.221534 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a92eacb4-3e96-4792-8fb2-036b65560bd0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:08.222323 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a92eacb4-3e96-4792-8fb2-036b65560bd0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:08.222758 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a92eacb4-3e96-4792-8fb2-036b65560bd0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:08.420461 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-a92eacb4-3e96-4792-8fb2-036b65560bd0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:08.433821 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-a92eacb4-3e96-4792-8fb2-036b65560bd0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1564 microversion: 2.1 time: 0.223277 May 25 16:23:08.442192 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 190/375] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:23:08 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1564 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:08.450499 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-70037375-ccde-4e84-8c6f-046a979d815c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:08.451373 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-70037375-ccde-4e84-8c6f-046a979d815c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:08.457878 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-70037375-ccde-4e84-8c6f-046a979d815c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:08.458640 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-70037375-ccde-4e84-8c6f-046a979d815c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:08.460421 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-70037375-ccde-4e84-8c6f-046a979d815c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:08.463948 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-70037375-ccde-4e84-8c6f-046a979d815c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:08.551720 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-70037375-ccde-4e84-8c6f-046a979d815c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105475 May 25 16:23:08.552299 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 186/376] 10.222.0.42 () {58 vars in 1274 bytes} [Wed May 25 16:23:08 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:23:09.044353 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-e3585282-5932-4b8d-bcc4-1e5901b5d22c req-041ab2f8-3689-4f28-96e8-c18c3878254c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3da72ce-f083-455e-ae40-9530c53126ef", "name": "network-vif-plugged", "status": "completed", "tag": "81d48be3-f76c-4118-bcaa-79360428da5a"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:23:09.060449 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-e3585282-5932-4b8d-bcc4-1e5901b5d22c req-041ab2f8-3689-4f28-96e8-c18c3878254c service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:09.063007 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-e3585282-5932-4b8d-bcc4-1e5901b5d22c req-041ab2f8-3689-4f28-96e8-c18c3878254c service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:09.068338 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-dcdadfe8-2b7f-4ae4-b368-a027d6d21759 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:09.069513 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-dcdadfe8-2b7f-4ae4-b368-a027d6d21759 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:09.077102 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-e3585282-5932-4b8d-bcc4-1e5901b5d22c req-041ab2f8-3689-4f28-96e8-c18c3878254c service nova] Creating event network-vif-plugged:81d48be3-f76c-4118-bcaa-79360428da5a for instance d3da72ce-f083-455e-ae40-9530c53126ef on hv-cinder-84327 May 25 16:23:09.083267 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-e3585282-5932-4b8d-bcc4-1e5901b5d22c req-041ab2f8-3689-4f28-96e8-c18c3878254c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042326 May 25 16:23:09.083773 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dcdadfe8-2b7f-4ae4-b368-a027d6d21759 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:09.084240 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dcdadfe8-2b7f-4ae4-b368-a027d6d21759 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:09.084932 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 191/377] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:23:09.085081 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dcdadfe8-2b7f-4ae4-b368-a027d6d21759 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:09.085677 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dcdadfe8-2b7f-4ae4-b368-a027d6d21759 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:09.096143 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-920776b7-872f-4bea-a051-b6bdf016ebb8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:09.096983 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-920776b7-872f-4bea-a051-b6bdf016ebb8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:09.105128 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-920776b7-872f-4bea-a051-b6bdf016ebb8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:09.105821 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-920776b7-872f-4bea-a051-b6bdf016ebb8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:09.106766 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-920776b7-872f-4bea-a051-b6bdf016ebb8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:09.107364 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-920776b7-872f-4bea-a051-b6bdf016ebb8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:09.133595 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=100 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:23:09.345922 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-920776b7-872f-4bea-a051-b6bdf016ebb8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:09.359531 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-920776b7-872f-4bea-a051-b6bdf016ebb8 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1723 microversion: 2.1 time: 0.273019 May 25 16:23:09.360111 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 192/378] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:23:09 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:09.367393 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-dcdadfe8-2b7f-4ae4-b368-a027d6d21759 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:09.390656 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-dcdadfe8-2b7f-4ae4-b368-a027d6d21759 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:09.394163 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-dcdadfe8-2b7f-4ae4-b368-a027d6d21759 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:09.398729 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-dcdadfe8-2b7f-4ae4-b368-a027d6d21759 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1738 microversion: 2.20 time: 0.334538 May 25 16:23:09.401013 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 187/379] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:09 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1738 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:23:10.002840 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-48f3df83-ea8f-4369-973e-5bedf6f3247c req-e8d5177d-1028-4a1c-a652-a20b6f64dbd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f68f3730-3984-4aef-9c58-e87b09051c87", "tag": "1b194465-a3bb-473d-8825-aed33ba4c44a"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:23:10.016096 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-48f3df83-ea8f-4369-973e-5bedf6f3247c req-e8d5177d-1028-4a1c-a652-a20b6f64dbd7 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:10.016541 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-48f3df83-ea8f-4369-973e-5bedf6f3247c req-e8d5177d-1028-4a1c-a652-a20b6f64dbd7 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:10.032438 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-48f3df83-ea8f-4369-973e-5bedf6f3247c req-e8d5177d-1028-4a1c-a652-a20b6f64dbd7 service nova] Creating event network-changed:1b194465-a3bb-473d-8825-aed33ba4c44a for instance f68f3730-3984-4aef-9c58-e87b09051c87 on hv-cinder-84327 May 25 16:23:10.046591 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-48f3df83-ea8f-4369-973e-5bedf6f3247c req-e8d5177d-1028-4a1c-a652-a20b6f64dbd7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046478 May 25 16:23:10.053976 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 193/380] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:23:10.376334 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-1e7c74d4-54cb-432c-a901-2ff6ddf96885 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:10.376957 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-1e7c74d4-54cb-432c-a901-2ff6ddf96885 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:10.386556 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1e7c74d4-54cb-432c-a901-2ff6ddf96885 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:10.387011 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1e7c74d4-54cb-432c-a901-2ff6ddf96885 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:10.387815 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1e7c74d4-54cb-432c-a901-2ff6ddf96885 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:10.390392 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1e7c74d4-54cb-432c-a901-2ff6ddf96885 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:10.421995 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-f476edff-c5f8-42cf-b8c9-61c2d0d4f94b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:10.423637 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-f476edff-c5f8-42cf-b8c9-61c2d0d4f94b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:10.441356 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f476edff-c5f8-42cf-b8c9-61c2d0d4f94b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:10.441984 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f476edff-c5f8-42cf-b8c9-61c2d0d4f94b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:10.442780 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f476edff-c5f8-42cf-b8c9-61c2d0d4f94b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:10.443221 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f476edff-c5f8-42cf-b8c9-61c2d0d4f94b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:10.746336 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-1e7c74d4-54cb-432c-a901-2ff6ddf96885 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:10.759987 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-1e7c74d4-54cb-432c-a901-2ff6ddf96885 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1723 microversion: 2.1 time: 0.387414 May 25 16:23:10.767962 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-f476edff-c5f8-42cf-b8c9-61c2d0d4f94b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:10.776124 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 188/381] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:23:10 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1723 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:10.782856 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-f476edff-c5f8-42cf-b8c9-61c2d0d4f94b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:10.786499 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-f476edff-c5f8-42cf-b8c9-61c2d0d4f94b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:10.790179 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-f476edff-c5f8-42cf-b8c9-61c2d0d4f94b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1738 microversion: 2.20 time: 0.371543 May 25 16:23:10.791480 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 194/382] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:10 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1738 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:11.789628 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-3f480e4f-de88-4a97-be39-4db03319ed35 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:11.792852 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-3f480e4f-de88-4a97-be39-4db03319ed35 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:11.812746 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3f480e4f-de88-4a97-be39-4db03319ed35 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:11.813661 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3f480e4f-de88-4a97-be39-4db03319ed35 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:11.815323 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3f480e4f-de88-4a97-be39-4db03319ed35 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:11.816164 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3f480e4f-de88-4a97-be39-4db03319ed35 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:11.828835 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-3f3661ab-141f-46a5-b1e1-97bb634db6dc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:11.829464 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-3f3661ab-141f-46a5-b1e1-97bb634db6dc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:11.873125 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3f3661ab-141f-46a5-b1e1-97bb634db6dc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:11.875265 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3f3661ab-141f-46a5-b1e1-97bb634db6dc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:11.876274 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3f3661ab-141f-46a5-b1e1-97bb634db6dc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:11.876711 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3f3661ab-141f-46a5-b1e1-97bb634db6dc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:12.034364 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-3f480e4f-de88-4a97-be39-4db03319ed35 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:12.044124 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-3f480e4f-de88-4a97-be39-4db03319ed35 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1723 microversion: 2.1 time: 0.263672 May 25 16:23:12.053699 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 189/383] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:23:11 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:12.138389 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-3f3661ab-141f-46a5-b1e1-97bb634db6dc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:12.153905 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-3f3661ab-141f-46a5-b1e1-97bb634db6dc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:12.155418 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-3f3661ab-141f-46a5-b1e1-97bb634db6dc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:12.156575 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-3f3661ab-141f-46a5-b1e1-97bb634db6dc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1738 microversion: 2.20 time: 0.331774 May 25 16:23:12.157134 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 195/384] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:11 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1738 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:13.063602 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-291e1804-3240-4448-a93e-8ee3b49a4d95 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:13.064205 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-291e1804-3240-4448-a93e-8ee3b49a4d95 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:13.071248 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-291e1804-3240-4448-a93e-8ee3b49a4d95 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:13.071700 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-291e1804-3240-4448-a93e-8ee3b49a4d95 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:13.072527 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-291e1804-3240-4448-a93e-8ee3b49a4d95 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:13.072971 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-291e1804-3240-4448-a93e-8ee3b49a4d95 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:13.176643 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-ec669ba2-b7c2-4ecc-b715-978d986e99e2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:13.176643 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-ec669ba2-b7c2-4ecc-b715-978d986e99e2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:13.190627 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ec669ba2-b7c2-4ecc-b715-978d986e99e2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:13.191085 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ec669ba2-b7c2-4ecc-b715-978d986e99e2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:13.195310 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ec669ba2-b7c2-4ecc-b715-978d986e99e2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:13.195808 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ec669ba2-b7c2-4ecc-b715-978d986e99e2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:13.244970 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-291e1804-3240-4448-a93e-8ee3b49a4d95 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:13.255038 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-291e1804-3240-4448-a93e-8ee3b49a4d95 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1723 microversion: 2.1 time: 0.198019 May 25 16:23:13.257764 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 190/385] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:23:13 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:13.367950 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-ec669ba2-b7c2-4ecc-b715-978d986e99e2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:13.376248 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-ec669ba2-b7c2-4ecc-b715-978d986e99e2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:13.378034 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-ec669ba2-b7c2-4ecc-b715-978d986e99e2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:13.379282 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-ec669ba2-b7c2-4ecc-b715-978d986e99e2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1738 microversion: 2.20 time: 0.207192 May 25 16:23:13.390644 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 196/386] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:13 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:14.275218 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-08571977-bf34-40e8-b144-15ccc013d427 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:14.276503 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-08571977-bf34-40e8-b144-15ccc013d427 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:14.285154 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-08571977-bf34-40e8-b144-15ccc013d427 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:14.285802 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-08571977-bf34-40e8-b144-15ccc013d427 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:14.286592 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-08571977-bf34-40e8-b144-15ccc013d427 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:14.287034 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-08571977-bf34-40e8-b144-15ccc013d427 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:14.400711 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-371e6446-ce7e-460b-a6dc-f193c34719a3 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:14.401415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-371e6446-ce7e-460b-a6dc-f193c34719a3 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:14.410805 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-371e6446-ce7e-460b-a6dc-f193c34719a3 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:14.411263 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-371e6446-ce7e-460b-a6dc-f193c34719a3 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:14.415370 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-371e6446-ce7e-460b-a6dc-f193c34719a3 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:14.415842 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-371e6446-ce7e-460b-a6dc-f193c34719a3 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:14.517492 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-08571977-bf34-40e8-b144-15ccc013d427 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:14.536900 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-08571977-bf34-40e8-b144-15ccc013d427 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1723 microversion: 2.1 time: 0.266363 May 25 16:23:14.540732 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 191/387] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:23:14 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:14.613305 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-371e6446-ce7e-460b-a6dc-f193c34719a3 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:14.622040 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-371e6446-ce7e-460b-a6dc-f193c34719a3 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:14.623141 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-371e6446-ce7e-460b-a6dc-f193c34719a3 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:14.624315 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-371e6446-ce7e-460b-a6dc-f193c34719a3 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1738 microversion: 2.20 time: 0.230583 May 25 16:23:14.624863 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 197/388] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:14 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:23:15.557659 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-5a1da966-d800-402c-93e0-d6c1de4aeffa tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:15.559202 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-5a1da966-d800-402c-93e0-d6c1de4aeffa tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:15.576534 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5a1da966-d800-402c-93e0-d6c1de4aeffa tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:15.576991 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5a1da966-d800-402c-93e0-d6c1de4aeffa tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:15.577800 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5a1da966-d800-402c-93e0-d6c1de4aeffa tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:15.578249 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5a1da966-d800-402c-93e0-d6c1de4aeffa tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:15.610230 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=100 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:23:15.643753 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-4c7fa4a1-c7eb-4781-90ff-a6b2a180d7bf tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:15.645508 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-4c7fa4a1-c7eb-4781-90ff-a6b2a180d7bf tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:15.653967 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4c7fa4a1-c7eb-4781-90ff-a6b2a180d7bf tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:15.655066 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4c7fa4a1-c7eb-4781-90ff-a6b2a180d7bf tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:15.656047 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4c7fa4a1-c7eb-4781-90ff-a6b2a180d7bf tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:15.656654 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4c7fa4a1-c7eb-4781-90ff-a6b2a180d7bf tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:15.812659 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-5a1da966-d800-402c-93e0-d6c1de4aeffa tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:15.825358 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-5a1da966-d800-402c-93e0-d6c1de4aeffa tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1700 microversion: 2.1 time: 0.271416 May 25 16:23:15.827109 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 192/389] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:23:15 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1700 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:15.844646 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-dfa5dc4b-1728-4c2c-9b8c-13d3d5606cd1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:23:15.852864 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dfa5dc4b-1728-4c2c-9b8c-13d3d5606cd1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:15.853439 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dfa5dc4b-1728-4c2c-9b8c-13d3d5606cd1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:15.861436 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-4c7fa4a1-c7eb-4781-90ff-a6b2a180d7bf tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:15.871321 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-4c7fa4a1-c7eb-4781-90ff-a6b2a180d7bf tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:15.873066 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-4c7fa4a1-c7eb-4781-90ff-a6b2a180d7bf tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:15.874511 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-4c7fa4a1-c7eb-4781-90ff-a6b2a180d7bf tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1738 microversion: 2.20 time: 0.235149 May 25 16:23:15.889473 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 198/390] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:15 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1738 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:15.925586 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-dfa5dc4b-1728-4c2c-9b8c-13d3d5606cd1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Going to try to start instance {{(pid=117510) start /opt/stack/nova/nova/compute/api.py:2730}} May 25 16:23:15.984827 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-dfa5dc4b-1728-4c2c-9b8c-13d3d5606cd1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "POST /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f/action" status: 202 len: 0 microversion: 2.1 time: 0.144260 May 25 16:23:15.985560 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 193/391] 10.222.0.42 () {60 vars in 1277 bytes} [Wed May 25 16:23:15 2022] POST /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 16:23:15.996070 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-6d343fa7-f045-4955-b6f5-eedb1c61bdc6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:15.996946 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-6d343fa7-f045-4955-b6f5-eedb1c61bdc6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:16.004417 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6d343fa7-f045-4955-b6f5-eedb1c61bdc6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:16.005425 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6d343fa7-f045-4955-b6f5-eedb1c61bdc6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:16.006863 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6d343fa7-f045-4955-b6f5-eedb1c61bdc6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:16.007642 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6d343fa7-f045-4955-b6f5-eedb1c61bdc6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:16.218872 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-6d343fa7-f045-4955-b6f5-eedb1c61bdc6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:16.227935 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-6d343fa7-f045-4955-b6f5-eedb1c61bdc6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1709 microversion: 2.1 time: 0.237712 May 25 16:23:16.228773 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 199/392] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:23:15 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1709 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:16.893836 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-8d9cc21b-dc97-4d8c-a7c7-67d737448eaa tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:16.894511 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-8d9cc21b-dc97-4d8c-a7c7-67d737448eaa tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:16.910680 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8d9cc21b-dc97-4d8c-a7c7-67d737448eaa tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:16.911489 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8d9cc21b-dc97-4d8c-a7c7-67d737448eaa tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:16.913297 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8d9cc21b-dc97-4d8c-a7c7-67d737448eaa tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:16.913985 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8d9cc21b-dc97-4d8c-a7c7-67d737448eaa tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:17.067950 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-8d9cc21b-dc97-4d8c-a7c7-67d737448eaa tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:17.080822 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-8d9cc21b-dc97-4d8c-a7c7-67d737448eaa tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:17.082358 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-8d9cc21b-dc97-4d8c-a7c7-67d737448eaa tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:17.083617 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-8d9cc21b-dc97-4d8c-a7c7-67d737448eaa tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1738 microversion: 2.20 time: 0.194883 May 25 16:23:17.084804 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 194/393] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:16 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:17.245225 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-ade4df68-3515-4fb5-96b3-0ec556499333 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:17.246028 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-ade4df68-3515-4fb5-96b3-0ec556499333 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:17.252189 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ade4df68-3515-4fb5-96b3-0ec556499333 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:17.252638 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ade4df68-3515-4fb5-96b3-0ec556499333 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:17.253607 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ade4df68-3515-4fb5-96b3-0ec556499333 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:17.254087 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ade4df68-3515-4fb5-96b3-0ec556499333 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:17.397339 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-ade4df68-3515-4fb5-96b3-0ec556499333 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:17.407436 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-ade4df68-3515-4fb5-96b3-0ec556499333 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1709 microversion: 2.1 time: 0.166892 May 25 16:23:17.418548 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 200/394] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:23:17 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1709 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:18.103244 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-cf1043df-fc0e-453b-9b1d-50b472f0d4b2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:18.103953 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-cf1043df-fc0e-453b-9b1d-50b472f0d4b2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:18.110461 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-cf1043df-fc0e-453b-9b1d-50b472f0d4b2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:18.110916 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-cf1043df-fc0e-453b-9b1d-50b472f0d4b2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:18.111689 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-cf1043df-fc0e-453b-9b1d-50b472f0d4b2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:18.112126 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-cf1043df-fc0e-453b-9b1d-50b472f0d4b2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:18.257199 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-cf1043df-fc0e-453b-9b1d-50b472f0d4b2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:18.265590 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-cf1043df-fc0e-453b-9b1d-50b472f0d4b2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:18.267109 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-cf1043df-fc0e-453b-9b1d-50b472f0d4b2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:18.268525 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-cf1043df-fc0e-453b-9b1d-50b472f0d4b2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1738 microversion: 2.20 time: 0.169367 May 25 16:23:18.269329 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 195/395] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:18 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:18.426092 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-b3b94641-c6df-4f48-bc66-d40c52b57bcb tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:18.427430 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-b3b94641-c6df-4f48-bc66-d40c52b57bcb tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:18.434473 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b3b94641-c6df-4f48-bc66-d40c52b57bcb tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:18.435228 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b3b94641-c6df-4f48-bc66-d40c52b57bcb tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:18.436219 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b3b94641-c6df-4f48-bc66-d40c52b57bcb tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:18.436885 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b3b94641-c6df-4f48-bc66-d40c52b57bcb tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:18.591838 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-b3b94641-c6df-4f48-bc66-d40c52b57bcb tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:18.600691 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-b3b94641-c6df-4f48-bc66-d40c52b57bcb tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1713 microversion: 2.1 time: 0.178940 May 25 16:23:18.601365 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 201/396] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:23:18 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1713 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:19.290814 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-666efc6e-4c36-461d-b1b9-2b889bc3ffa9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:19.291928 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-666efc6e-4c36-461d-b1b9-2b889bc3ffa9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:19.299905 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-666efc6e-4c36-461d-b1b9-2b889bc3ffa9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:19.300346 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-666efc6e-4c36-461d-b1b9-2b889bc3ffa9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:19.301104 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-666efc6e-4c36-461d-b1b9-2b889bc3ffa9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:19.301530 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-666efc6e-4c36-461d-b1b9-2b889bc3ffa9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:19.431382 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-666efc6e-4c36-461d-b1b9-2b889bc3ffa9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:19.439253 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-666efc6e-4c36-461d-b1b9-2b889bc3ffa9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:19.440725 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-666efc6e-4c36-461d-b1b9-2b889bc3ffa9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:19.441878 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-666efc6e-4c36-461d-b1b9-2b889bc3ffa9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1738 microversion: 2.20 time: 0.156582 May 25 16:23:19.442433 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 196/397] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:19 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:20.460436 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-20235f38-8c72-4cc0-a2f3-6737e650176b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:20.461107 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-20235f38-8c72-4cc0-a2f3-6737e650176b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:20.463073 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_api:SELECT=98 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:23:20.468273 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-20235f38-8c72-4cc0-a2f3-6737e650176b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:20.468716 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-20235f38-8c72-4cc0-a2f3-6737e650176b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:20.469462 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-20235f38-8c72-4cc0-a2f3-6737e650176b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:20.469936 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-20235f38-8c72-4cc0-a2f3-6737e650176b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:20.598380 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-20235f38-8c72-4cc0-a2f3-6737e650176b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:20.606173 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-20235f38-8c72-4cc0-a2f3-6737e650176b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:20.607670 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-20235f38-8c72-4cc0-a2f3-6737e650176b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:20.608803 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-20235f38-8c72-4cc0-a2f3-6737e650176b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1720 microversion: 2.20 time: 0.152318 May 25 16:23:20.609351 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 202/398] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:20 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:23:21.627915 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-611e9a72-7ebb-4790-92ea-07a4b20fd464 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:21.628434 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-611e9a72-7ebb-4790-92ea-07a4b20fd464 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:21.634947 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-611e9a72-7ebb-4790-92ea-07a4b20fd464 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:21.635395 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-611e9a72-7ebb-4790-92ea-07a4b20fd464 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:21.636157 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-611e9a72-7ebb-4790-92ea-07a4b20fd464 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:21.636594 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-611e9a72-7ebb-4790-92ea-07a4b20fd464 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:21.770191 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-611e9a72-7ebb-4790-92ea-07a4b20fd464 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:21.778539 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-611e9a72-7ebb-4790-92ea-07a4b20fd464 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:21.780036 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-611e9a72-7ebb-4790-92ea-07a4b20fd464 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:21.781181 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-611e9a72-7ebb-4790-92ea-07a4b20fd464 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1720 microversion: 2.20 time: 0.157307 May 25 16:23:21.781738 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 197/399] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:21 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:22.800501 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-da9c3f2e-8273-4f77-8d19-e42ddfd51248 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:22.801136 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-da9c3f2e-8273-4f77-8d19-e42ddfd51248 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:22.808907 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-da9c3f2e-8273-4f77-8d19-e42ddfd51248 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:22.809359 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-da9c3f2e-8273-4f77-8d19-e42ddfd51248 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:22.810162 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-da9c3f2e-8273-4f77-8d19-e42ddfd51248 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:22.810605 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-da9c3f2e-8273-4f77-8d19-e42ddfd51248 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:22.940331 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-da9c3f2e-8273-4f77-8d19-e42ddfd51248 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:22.948990 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-da9c3f2e-8273-4f77-8d19-e42ddfd51248 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:22.950569 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-da9c3f2e-8273-4f77-8d19-e42ddfd51248 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:22.951848 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-da9c3f2e-8273-4f77-8d19-e42ddfd51248 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1720 microversion: 2.20 time: 0.155731 May 25 16:23:22.952409 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 203/400] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:22 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:23.969271 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-71483f94-31b1-4994-b448-fab5e2589e28 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:23.970003 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-71483f94-31b1-4994-b448-fab5e2589e28 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:23.976477 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-71483f94-31b1-4994-b448-fab5e2589e28 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:23.976924 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-71483f94-31b1-4994-b448-fab5e2589e28 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:23.977675 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-71483f94-31b1-4994-b448-fab5e2589e28 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:23.978146 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-71483f94-31b1-4994-b448-fab5e2589e28 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:24.109298 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-71483f94-31b1-4994-b448-fab5e2589e28 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:24.118195 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-71483f94-31b1-4994-b448-fab5e2589e28 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:24.119707 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-71483f94-31b1-4994-b448-fab5e2589e28 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:24.120914 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-71483f94-31b1-4994-b448-fab5e2589e28 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1723 microversion: 2.20 time: 0.155448 May 25 16:23:24.121470 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 198/401] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:23 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:24.139129 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-e9ad9130-c1b6-4798-a806-1453127bf401 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09569e49-293c-4b27-a9b3-34a037742940"}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:23:24.140158 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-e9ad9130-c1b6-4798-a806-1453127bf401 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:24.153645 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e9ad9130-c1b6-4798-a806-1453127bf401 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:24.153645 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e9ad9130-c1b6-4798-a806-1453127bf401 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:24.153645 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e9ad9130-c1b6-4798-a806-1453127bf401 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:24.153645 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e9ad9130-c1b6-4798-a806-1453127bf401 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:24.440190 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-e9ad9130-c1b6-4798-a806-1453127bf401 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "POST /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.304971 May 25 16:23:24.440784 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 204/402] 10.222.0.42 () {62 vars in 1363 bytes} [Wed May 25 16:23:24 2022] POST /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef/os-volume_attachments => generated 188 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:23:24.562124 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-d85cdc80-5691-416d-a5ec-4e43e5fe257b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:23:24.562919 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-d85cdc80-5691-416d-a5ec-4e43e5fe257b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:24.570889 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d85cdc80-5691-416d-a5ec-4e43e5fe257b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:24.571394 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d85cdc80-5691-416d-a5ec-4e43e5fe257b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:24.572221 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d85cdc80-5691-416d-a5ec-4e43e5fe257b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:24.572654 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d85cdc80-5691-416d-a5ec-4e43e5fe257b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:24.665002 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-d85cdc80-5691-416d-a5ec-4e43e5fe257b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "POST /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef/action" status: 202 len: 0 microversion: 2.20 time: 0.108762 May 25 16:23:24.665610 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 199/403] 10.222.0.42 () {62 vars in 1318 bytes} [Wed May 25 16:23:24 2022] POST /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 16:23:24.673626 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-89769666-1531-45cc-bba5-b52f7a189d02 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:24.674259 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-89769666-1531-45cc-bba5-b52f7a189d02 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:24.680589 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-89769666-1531-45cc-bba5-b52f7a189d02 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:24.681031 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-89769666-1531-45cc-bba5-b52f7a189d02 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:24.681821 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-89769666-1531-45cc-bba5-b52f7a189d02 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:24.682253 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-89769666-1531-45cc-bba5-b52f7a189d02 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:24.818376 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-89769666-1531-45cc-bba5-b52f7a189d02 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:24.826686 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-89769666-1531-45cc-bba5-b52f7a189d02 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:24.828823 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-89769666-1531-45cc-bba5-b52f7a189d02 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:24.829992 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-89769666-1531-45cc-bba5-b52f7a189d02 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1809 microversion: 2.20 time: 0.160230 May 25 16:23:24.830543 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 205/404] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:24 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:25.013795 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-d56831d8-6393-4fd5-8f0a-83c356571c2c req-6d4fa649-f086-4dac-8903-129dc81d4b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3da72ce-f083-455e-ae40-9530c53126ef", "name": "network-vif-unplugged", "status": "completed", "tag": "81d48be3-f76c-4118-bcaa-79360428da5a"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:23:25.028918 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-d56831d8-6393-4fd5-8f0a-83c356571c2c req-6d4fa649-f086-4dac-8903-129dc81d4b42 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:25.029425 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-d56831d8-6393-4fd5-8f0a-83c356571c2c req-6d4fa649-f086-4dac-8903-129dc81d4b42 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:25.042090 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.compute.server_external_events [req-d56831d8-6393-4fd5-8f0a-83c356571c2c req-6d4fa649-f086-4dac-8903-129dc81d4b42 service nova] Unable to find a host for instance d3da72ce-f083-455e-ae40-9530c53126ef. Dropping event network-vif-unplugged {{(pid=117510) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 25 16:23:25.043780 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-d56831d8-6393-4fd5-8f0a-83c356571c2c req-6d4fa649-f086-4dac-8903-129dc81d4b42 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034935 May 25 16:23:25.046290 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 200/405] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 25 16:23:25.852724 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-be20cf5c-62f6-4c89-bc14-3abc764fe64a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:25.853387 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-be20cf5c-62f6-4c89-bc14-3abc764fe64a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:25.861934 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-be20cf5c-62f6-4c89-bc14-3abc764fe64a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:25.862531 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-be20cf5c-62f6-4c89-bc14-3abc764fe64a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:25.863285 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-be20cf5c-62f6-4c89-bc14-3abc764fe64a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:25.863875 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-be20cf5c-62f6-4c89-bc14-3abc764fe64a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:26.001846 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-be20cf5c-62f6-4c89-bc14-3abc764fe64a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:26.011022 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-be20cf5c-62f6-4c89-bc14-3abc764fe64a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:26.012584 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-be20cf5c-62f6-4c89-bc14-3abc764fe64a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:26.013734 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-be20cf5c-62f6-4c89-bc14-3abc764fe64a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1751 microversion: 2.20 time: 0.165866 May 25 16:23:26.014290 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 206/406] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:25 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:27.032825 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-0db07d75-784d-4d91-9cf8-cc6db2014705 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:27.033435 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-0db07d75-784d-4d91-9cf8-cc6db2014705 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:27.040444 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0db07d75-784d-4d91-9cf8-cc6db2014705 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:27.040894 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0db07d75-784d-4d91-9cf8-cc6db2014705 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:27.041664 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0db07d75-784d-4d91-9cf8-cc6db2014705 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:27.042151 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0db07d75-784d-4d91-9cf8-cc6db2014705 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:27.170563 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-0db07d75-784d-4d91-9cf8-cc6db2014705 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:27.180046 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-0db07d75-784d-4d91-9cf8-cc6db2014705 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:27.181634 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-0db07d75-784d-4d91-9cf8-cc6db2014705 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:27.182783 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-0db07d75-784d-4d91-9cf8-cc6db2014705 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1807 microversion: 2.20 time: 0.154150 May 25 16:23:27.183468 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 201/407] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:27 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:28.201759 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-8b734894-22a2-4eea-a2d8-020597a46b5d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:28.202371 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-8b734894-22a2-4eea-a2d8-020597a46b5d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:28.208522 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8b734894-22a2-4eea-a2d8-020597a46b5d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:28.209114 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8b734894-22a2-4eea-a2d8-020597a46b5d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:28.209789 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8b734894-22a2-4eea-a2d8-020597a46b5d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:28.210246 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8b734894-22a2-4eea-a2d8-020597a46b5d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:28.214703 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:23:28.387870 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-8b734894-22a2-4eea-a2d8-020597a46b5d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:28.398258 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-8b734894-22a2-4eea-a2d8-020597a46b5d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:28.399886 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-8b734894-22a2-4eea-a2d8-020597a46b5d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:28.401082 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-8b734894-22a2-4eea-a2d8-020597a46b5d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1807 microversion: 2.20 time: 0.203175 May 25 16:23:28.401636 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 207/408] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:28 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1807 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:29.420514 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-349ff7f3-25d7-4228-9baa-371dc1525932 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:29.421252 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-349ff7f3-25d7-4228-9baa-371dc1525932 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:29.430452 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-349ff7f3-25d7-4228-9baa-371dc1525932 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:29.430903 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-349ff7f3-25d7-4228-9baa-371dc1525932 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:29.431697 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-349ff7f3-25d7-4228-9baa-371dc1525932 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:29.432107 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-349ff7f3-25d7-4228-9baa-371dc1525932 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:29.797016 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-349ff7f3-25d7-4228-9baa-371dc1525932 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:29.807056 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-349ff7f3-25d7-4228-9baa-371dc1525932 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:29.808539 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-349ff7f3-25d7-4228-9baa-371dc1525932 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:29.810010 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-349ff7f3-25d7-4228-9baa-371dc1525932 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1807 microversion: 2.20 time: 0.394265 May 25 16:23:29.810593 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 202/409] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:29 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1807 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:30.830420 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-30c96727-e589-41af-9ae5-a9df78c45805 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:30.831125 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-30c96727-e589-41af-9ae5-a9df78c45805 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:30.845793 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-30c96727-e589-41af-9ae5-a9df78c45805 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:30.846240 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-30c96727-e589-41af-9ae5-a9df78c45805 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:30.847017 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-30c96727-e589-41af-9ae5-a9df78c45805 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:30.847449 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-30c96727-e589-41af-9ae5-a9df78c45805 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:30.981014 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-30c96727-e589-41af-9ae5-a9df78c45805 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:30.989664 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-30c96727-e589-41af-9ae5-a9df78c45805 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:30.991456 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-30c96727-e589-41af-9ae5-a9df78c45805 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:30.992613 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-30c96727-e589-41af-9ae5-a9df78c45805 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1807 microversion: 2.20 time: 0.166459 May 25 16:23:30.993423 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 208/410] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:30 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:32.012092 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-0152ceb6-896a-4657-a6ba-a2bb585b2609 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:32.012769 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-0152ceb6-896a-4657-a6ba-a2bb585b2609 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:32.015322 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_api:SELECT=60 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:23:32.021012 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0152ceb6-896a-4657-a6ba-a2bb585b2609 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:32.021826 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0152ceb6-896a-4657-a6ba-a2bb585b2609 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:32.022624 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0152ceb6-896a-4657-a6ba-a2bb585b2609 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:32.023365 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0152ceb6-896a-4657-a6ba-a2bb585b2609 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:32.158651 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-0152ceb6-896a-4657-a6ba-a2bb585b2609 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:32.167805 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-0152ceb6-896a-4657-a6ba-a2bb585b2609 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:32.169299 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-0152ceb6-896a-4657-a6ba-a2bb585b2609 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:32.170486 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-0152ceb6-896a-4657-a6ba-a2bb585b2609 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1807 microversion: 2.20 time: 0.162824 May 25 16:23:32.171045 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 203/411] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:32 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:33.191284 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-bb2e0df5-b979-43bd-98fd-5e6c63fc9df4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:33.191911 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-bb2e0df5-b979-43bd-98fd-5e6c63fc9df4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:33.198579 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-bb2e0df5-b979-43bd-98fd-5e6c63fc9df4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:33.199041 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-bb2e0df5-b979-43bd-98fd-5e6c63fc9df4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:33.199790 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-bb2e0df5-b979-43bd-98fd-5e6c63fc9df4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:33.200217 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-bb2e0df5-b979-43bd-98fd-5e6c63fc9df4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:33.333152 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-bb2e0df5-b979-43bd-98fd-5e6c63fc9df4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:33.342634 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-bb2e0df5-b979-43bd-98fd-5e6c63fc9df4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:33.344276 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-bb2e0df5-b979-43bd-98fd-5e6c63fc9df4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:33.345313 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-bb2e0df5-b979-43bd-98fd-5e6c63fc9df4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1807 microversion: 2.20 time: 0.157905 May 25 16:23:33.346042 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 209/412] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:33 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:34.364746 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-5cc3a6cc-e390-4977-bf3a-d4d9a6a4d302 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:34.365352 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-5cc3a6cc-e390-4977-bf3a-d4d9a6a4d302 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:34.372762 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5cc3a6cc-e390-4977-bf3a-d4d9a6a4d302 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:34.374456 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5cc3a6cc-e390-4977-bf3a-d4d9a6a4d302 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:34.375406 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5cc3a6cc-e390-4977-bf3a-d4d9a6a4d302 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:34.375879 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5cc3a6cc-e390-4977-bf3a-d4d9a6a4d302 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:34.529755 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-5cc3a6cc-e390-4977-bf3a-d4d9a6a4d302 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:34.538451 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-5cc3a6cc-e390-4977-bf3a-d4d9a6a4d302 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:34.539949 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-5cc3a6cc-e390-4977-bf3a-d4d9a6a4d302 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:34.541133 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-5cc3a6cc-e390-4977-bf3a-d4d9a6a4d302 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1807 microversion: 2.20 time: 0.180399 May 25 16:23:34.541692 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 204/413] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:34 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:35.559595 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-6dfba8ee-7c80-4a3f-82cd-56e1823b793e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:35.560228 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-6dfba8ee-7c80-4a3f-82cd-56e1823b793e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:35.566361 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6dfba8ee-7c80-4a3f-82cd-56e1823b793e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:35.566813 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6dfba8ee-7c80-4a3f-82cd-56e1823b793e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:35.567572 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6dfba8ee-7c80-4a3f-82cd-56e1823b793e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:35.568005 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6dfba8ee-7c80-4a3f-82cd-56e1823b793e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:35.708147 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-6dfba8ee-7c80-4a3f-82cd-56e1823b793e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:35.717083 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-6dfba8ee-7c80-4a3f-82cd-56e1823b793e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:35.718625 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-6dfba8ee-7c80-4a3f-82cd-56e1823b793e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:35.719763 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-6dfba8ee-7c80-4a3f-82cd-56e1823b793e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1807 microversion: 2.20 time: 0.164058 May 25 16:23:35.720311 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 210/414] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:35 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:36.738850 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-c5f721b0-c8b3-4903-a9b2-6dd93081d123 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:36.739456 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-c5f721b0-c8b3-4903-a9b2-6dd93081d123 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:36.747574 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c5f721b0-c8b3-4903-a9b2-6dd93081d123 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:36.748044 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c5f721b0-c8b3-4903-a9b2-6dd93081d123 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:36.749008 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c5f721b0-c8b3-4903-a9b2-6dd93081d123 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:36.749456 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c5f721b0-c8b3-4903-a9b2-6dd93081d123 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:36.894245 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-c5f721b0-c8b3-4903-a9b2-6dd93081d123 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:36.903176 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-c5f721b0-c8b3-4903-a9b2-6dd93081d123 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:36.904672 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-c5f721b0-c8b3-4903-a9b2-6dd93081d123 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:36.905857 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-c5f721b0-c8b3-4903-a9b2-6dd93081d123 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1807 microversion: 2.20 time: 0.171282 May 25 16:23:36.906446 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 205/415] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:36 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:37.924457 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-2843ddaa-b24a-4f8a-b61a-c623ee0a779a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:37.925128 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-2843ddaa-b24a-4f8a-b61a-c623ee0a779a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:37.931330 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2843ddaa-b24a-4f8a-b61a-c623ee0a779a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:37.931780 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2843ddaa-b24a-4f8a-b61a-c623ee0a779a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:37.933235 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2843ddaa-b24a-4f8a-b61a-c623ee0a779a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:37.936899 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2843ddaa-b24a-4f8a-b61a-c623ee0a779a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:38.073538 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-2843ddaa-b24a-4f8a-b61a-c623ee0a779a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:38.082090 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-2843ddaa-b24a-4f8a-b61a-c623ee0a779a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:38.083834 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-2843ddaa-b24a-4f8a-b61a-c623ee0a779a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:38.085326 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-2843ddaa-b24a-4f8a-b61a-c623ee0a779a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1807 microversion: 2.20 time: 0.164709 May 25 16:23:38.086092 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 211/416] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:37 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:39.105180 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-253c49cc-8fb0-4b0e-824d-d1e57be390a1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:39.105831 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-253c49cc-8fb0-4b0e-824d-d1e57be390a1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:39.112797 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-253c49cc-8fb0-4b0e-824d-d1e57be390a1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:39.113246 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-253c49cc-8fb0-4b0e-824d-d1e57be390a1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:39.114067 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-253c49cc-8fb0-4b0e-824d-d1e57be390a1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:39.114795 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-253c49cc-8fb0-4b0e-824d-d1e57be390a1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:39.263112 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-253c49cc-8fb0-4b0e-824d-d1e57be390a1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:39.271437 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-253c49cc-8fb0-4b0e-824d-d1e57be390a1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:39.272912 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-253c49cc-8fb0-4b0e-824d-d1e57be390a1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:39.274079 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-253c49cc-8fb0-4b0e-824d-d1e57be390a1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1807 microversion: 2.20 time: 0.173451 May 25 16:23:39.274627 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 206/417] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:39 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:40.292843 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-55eb743e-24cc-4e30-9124-b933307d2d99 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:40.293554 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-55eb743e-24cc-4e30-9124-b933307d2d99 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:40.300720 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-55eb743e-24cc-4e30-9124-b933307d2d99 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:40.301255 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-55eb743e-24cc-4e30-9124-b933307d2d99 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:40.302132 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-55eb743e-24cc-4e30-9124-b933307d2d99 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:40.302634 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-55eb743e-24cc-4e30-9124-b933307d2d99 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:40.444988 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-55eb743e-24cc-4e30-9124-b933307d2d99 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:40.455085 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-55eb743e-24cc-4e30-9124-b933307d2d99 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:40.459863 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-55eb743e-24cc-4e30-9124-b933307d2d99 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:40.459863 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-55eb743e-24cc-4e30-9124-b933307d2d99 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1807 microversion: 2.20 time: 0.169125 May 25 16:23:40.464400 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 212/418] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:40 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:23:41.476268 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-3ae8c11b-2245-4810-bab1-71e2cd5f6c01 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:41.476838 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-3ae8c11b-2245-4810-bab1-71e2cd5f6c01 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:41.485506 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3ae8c11b-2245-4810-bab1-71e2cd5f6c01 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:41.485977 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3ae8c11b-2245-4810-bab1-71e2cd5f6c01 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:41.486865 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3ae8c11b-2245-4810-bab1-71e2cd5f6c01 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:41.487583 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3ae8c11b-2245-4810-bab1-71e2cd5f6c01 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:41.629146 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-3ae8c11b-2245-4810-bab1-71e2cd5f6c01 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:41.631347 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:23:41.639557 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-3ae8c11b-2245-4810-bab1-71e2cd5f6c01 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:41.641052 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-3ae8c11b-2245-4810-bab1-71e2cd5f6c01 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:41.642236 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-3ae8c11b-2245-4810-bab1-71e2cd5f6c01 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1807 microversion: 2.20 time: 0.170083 May 25 16:23:41.642878 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 207/419] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:41 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:42.660777 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-61662d54-7a41-478a-aff4-71e062342ccb tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:42.661390 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-61662d54-7a41-478a-aff4-71e062342ccb tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:42.667777 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-61662d54-7a41-478a-aff4-71e062342ccb tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:42.668252 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-61662d54-7a41-478a-aff4-71e062342ccb tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:42.669115 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-61662d54-7a41-478a-aff4-71e062342ccb tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:42.669553 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-61662d54-7a41-478a-aff4-71e062342ccb tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:42.800634 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-61662d54-7a41-478a-aff4-71e062342ccb tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:42.808579 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-61662d54-7a41-478a-aff4-71e062342ccb tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:42.810684 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-61662d54-7a41-478a-aff4-71e062342ccb tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:42.811847 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-61662d54-7a41-478a-aff4-71e062342ccb tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1807 microversion: 2.20 time: 0.155089 May 25 16:23:42.812409 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 213/420] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:42 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:43.830564 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-25b1eb4b-7009-45be-bdc3-1223e65c11ca tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:43.831167 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-25b1eb4b-7009-45be-bdc3-1223e65c11ca tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:43.838796 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-25b1eb4b-7009-45be-bdc3-1223e65c11ca tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:43.839245 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-25b1eb4b-7009-45be-bdc3-1223e65c11ca tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:43.840597 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-25b1eb4b-7009-45be-bdc3-1223e65c11ca tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:43.841072 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-25b1eb4b-7009-45be-bdc3-1223e65c11ca tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:43.971564 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-25b1eb4b-7009-45be-bdc3-1223e65c11ca tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:43.979896 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-25b1eb4b-7009-45be-bdc3-1223e65c11ca tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:43.981565 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-25b1eb4b-7009-45be-bdc3-1223e65c11ca tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:43.982736 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-25b1eb4b-7009-45be-bdc3-1223e65c11ca tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1807 microversion: 2.20 time: 0.156439 May 25 16:23:43.983299 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 208/421] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:43 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:45.000166 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-e996a48d-c50a-4840-8965-44eb7d14d0ab tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:45.000796 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-e996a48d-c50a-4840-8965-44eb7d14d0ab tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:45.006834 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e996a48d-c50a-4840-8965-44eb7d14d0ab tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:45.007287 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e996a48d-c50a-4840-8965-44eb7d14d0ab tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:45.008050 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e996a48d-c50a-4840-8965-44eb7d14d0ab tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:45.008491 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e996a48d-c50a-4840-8965-44eb7d14d0ab tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:45.134130 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-e996a48d-c50a-4840-8965-44eb7d14d0ab tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:45.142512 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-e996a48d-c50a-4840-8965-44eb7d14d0ab tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:45.144432 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-e996a48d-c50a-4840-8965-44eb7d14d0ab tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:45.145580 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-e996a48d-c50a-4840-8965-44eb7d14d0ab tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1807 microversion: 2.20 time: 0.149432 May 25 16:23:45.146176 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 214/422] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:44 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:46.164620 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-22235ce2-6638-47d6-84c6-0f19f1b381fe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:46.165222 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-22235ce2-6638-47d6-84c6-0f19f1b381fe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:46.172340 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-22235ce2-6638-47d6-84c6-0f19f1b381fe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:46.172786 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-22235ce2-6638-47d6-84c6-0f19f1b381fe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:46.173537 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-22235ce2-6638-47d6-84c6-0f19f1b381fe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:46.174005 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-22235ce2-6638-47d6-84c6-0f19f1b381fe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:46.304222 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-22235ce2-6638-47d6-84c6-0f19f1b381fe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:46.313368 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-22235ce2-6638-47d6-84c6-0f19f1b381fe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:46.314905 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-22235ce2-6638-47d6-84c6-0f19f1b381fe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:46.316041 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-22235ce2-6638-47d6-84c6-0f19f1b381fe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1807 microversion: 2.20 time: 0.155531 May 25 16:23:46.316596 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 209/423] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:46 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:47.334427 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-7a2bc9f2-c2ca-44aa-a0e5-d0e3fe06af70 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:47.335056 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-7a2bc9f2-c2ca-44aa-a0e5-d0e3fe06af70 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:47.342087 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7a2bc9f2-c2ca-44aa-a0e5-d0e3fe06af70 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:47.342528 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7a2bc9f2-c2ca-44aa-a0e5-d0e3fe06af70 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:47.343312 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7a2bc9f2-c2ca-44aa-a0e5-d0e3fe06af70 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:47.343739 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7a2bc9f2-c2ca-44aa-a0e5-d0e3fe06af70 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:47.469893 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-7a2bc9f2-c2ca-44aa-a0e5-d0e3fe06af70 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:47.478115 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-7a2bc9f2-c2ca-44aa-a0e5-d0e3fe06af70 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:47.479615 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-7a2bc9f2-c2ca-44aa-a0e5-d0e3fe06af70 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:47.481512 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-7a2bc9f2-c2ca-44aa-a0e5-d0e3fe06af70 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1807 microversion: 2.20 time: 0.150234 May 25 16:23:47.482533 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 215/424] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:47 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:48.501253 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-56d76749-b2cd-4b6e-9891-b85cf818710e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:48.501889 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-56d76749-b2cd-4b6e-9891-b85cf818710e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:48.508542 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-56d76749-b2cd-4b6e-9891-b85cf818710e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:48.508992 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-56d76749-b2cd-4b6e-9891-b85cf818710e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:48.509778 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-56d76749-b2cd-4b6e-9891-b85cf818710e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:48.510219 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-56d76749-b2cd-4b6e-9891-b85cf818710e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:48.643748 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-56d76749-b2cd-4b6e-9891-b85cf818710e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:48.652086 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-56d76749-b2cd-4b6e-9891-b85cf818710e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:48.654130 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-56d76749-b2cd-4b6e-9891-b85cf818710e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:48.655283 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-56d76749-b2cd-4b6e-9891-b85cf818710e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1807 microversion: 2.20 time: 0.157968 May 25 16:23:48.655846 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 210/425] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:48 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:49.673975 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-2a77ee2f-a165-4376-a417-bc90de6cdaed tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:49.674656 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-2a77ee2f-a165-4376-a417-bc90de6cdaed tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:49.682438 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2a77ee2f-a165-4376-a417-bc90de6cdaed tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:49.682886 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2a77ee2f-a165-4376-a417-bc90de6cdaed tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:49.683749 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2a77ee2f-a165-4376-a417-bc90de6cdaed tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:49.684239 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2a77ee2f-a165-4376-a417-bc90de6cdaed tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:49.811025 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-2a77ee2f-a165-4376-a417-bc90de6cdaed tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:49.819370 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-2a77ee2f-a165-4376-a417-bc90de6cdaed tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:49.820873 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-2a77ee2f-a165-4376-a417-bc90de6cdaed tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:49.822051 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-2a77ee2f-a165-4376-a417-bc90de6cdaed tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1807 microversion: 2.20 time: 0.152164 May 25 16:23:49.822605 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 216/426] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:49 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:50.840750 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-89751ee3-5504-45f9-ba0d-f68f79405119 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:50.841975 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-89751ee3-5504-45f9-ba0d-f68f79405119 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:50.848548 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-89751ee3-5504-45f9-ba0d-f68f79405119 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:50.848998 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-89751ee3-5504-45f9-ba0d-f68f79405119 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:50.849796 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-89751ee3-5504-45f9-ba0d-f68f79405119 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:50.850235 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-89751ee3-5504-45f9-ba0d-f68f79405119 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:50.981172 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-89751ee3-5504-45f9-ba0d-f68f79405119 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:50.991186 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-89751ee3-5504-45f9-ba0d-f68f79405119 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:50.992806 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-89751ee3-5504-45f9-ba0d-f68f79405119 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:50.993994 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-89751ee3-5504-45f9-ba0d-f68f79405119 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1807 microversion: 2.20 time: 0.157117 May 25 16:23:50.994563 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 211/427] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:50 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:52.015014 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-44f7f5df-d47e-4cb2-8a13-76082c3cc311 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:52.015625 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-44f7f5df-d47e-4cb2-8a13-76082c3cc311 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:52.017507 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_api:SELECT=30 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:23:52.022976 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-44f7f5df-d47e-4cb2-8a13-76082c3cc311 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:52.023425 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-44f7f5df-d47e-4cb2-8a13-76082c3cc311 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:52.024188 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-44f7f5df-d47e-4cb2-8a13-76082c3cc311 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:52.024621 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-44f7f5df-d47e-4cb2-8a13-76082c3cc311 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:52.154122 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-44f7f5df-d47e-4cb2-8a13-76082c3cc311 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:52.162770 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-44f7f5df-d47e-4cb2-8a13-76082c3cc311 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:52.164271 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-44f7f5df-d47e-4cb2-8a13-76082c3cc311 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:52.165433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-44f7f5df-d47e-4cb2-8a13-76082c3cc311 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1807 microversion: 2.20 time: 0.154975 May 25 16:23:52.166007 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 217/428] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:52 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:53.183493 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-11367179-cef3-40ff-a0c6-3fe1b50134f7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:53.184099 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-11367179-cef3-40ff-a0c6-3fe1b50134f7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:53.191238 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-11367179-cef3-40ff-a0c6-3fe1b50134f7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:53.191689 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-11367179-cef3-40ff-a0c6-3fe1b50134f7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:53.192450 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-11367179-cef3-40ff-a0c6-3fe1b50134f7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:53.192891 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-11367179-cef3-40ff-a0c6-3fe1b50134f7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:53.320666 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-11367179-cef3-40ff-a0c6-3fe1b50134f7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:53.329630 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-11367179-cef3-40ff-a0c6-3fe1b50134f7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:53.331180 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-11367179-cef3-40ff-a0c6-3fe1b50134f7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:53.332382 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-11367179-cef3-40ff-a0c6-3fe1b50134f7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1807 microversion: 2.20 time: 0.152822 May 25 16:23:53.332941 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 212/429] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:53 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:54.350161 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-35041159-afb3-46e5-aed0-13ab412360c0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:54.350751 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-35041159-afb3-46e5-aed0-13ab412360c0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:54.357377 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-35041159-afb3-46e5-aed0-13ab412360c0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:54.358022 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-35041159-afb3-46e5-aed0-13ab412360c0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:54.358841 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-35041159-afb3-46e5-aed0-13ab412360c0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:54.359268 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-35041159-afb3-46e5-aed0-13ab412360c0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:54.510920 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-35041159-afb3-46e5-aed0-13ab412360c0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:54.524023 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-35041159-afb3-46e5-aed0-13ab412360c0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:54.526491 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-35041159-afb3-46e5-aed0-13ab412360c0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:54.527444 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-35041159-afb3-46e5-aed0-13ab412360c0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1807 microversion: 2.20 time: 0.181488 May 25 16:23:54.527998 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 218/430] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:54 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:55.551599 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-060241e7-3d3d-4223-aeca-b5468d4d9d1a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:55.552290 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-060241e7-3d3d-4223-aeca-b5468d4d9d1a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:55.558705 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-060241e7-3d3d-4223-aeca-b5468d4d9d1a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:55.559153 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-060241e7-3d3d-4223-aeca-b5468d4d9d1a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:55.559917 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-060241e7-3d3d-4223-aeca-b5468d4d9d1a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:55.560354 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-060241e7-3d3d-4223-aeca-b5468d4d9d1a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:55.694401 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-060241e7-3d3d-4223-aeca-b5468d4d9d1a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:55.703652 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-060241e7-3d3d-4223-aeca-b5468d4d9d1a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:55.705203 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-060241e7-3d3d-4223-aeca-b5468d4d9d1a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:55.706334 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-060241e7-3d3d-4223-aeca-b5468d4d9d1a tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1807 microversion: 2.20 time: 0.158833 May 25 16:23:55.707099 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 213/431] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:55 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:56.724107 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-5a1f0a0a-2bea-4bd4-8177-b20570d9cbf0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:56.724690 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-5a1f0a0a-2bea-4bd4-8177-b20570d9cbf0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:56.730674 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5a1f0a0a-2bea-4bd4-8177-b20570d9cbf0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:56.731390 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5a1f0a0a-2bea-4bd4-8177-b20570d9cbf0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:56.732285 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5a1f0a0a-2bea-4bd4-8177-b20570d9cbf0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:56.733145 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5a1f0a0a-2bea-4bd4-8177-b20570d9cbf0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:56.862328 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-5a1f0a0a-2bea-4bd4-8177-b20570d9cbf0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:56.870578 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-5a1f0a0a-2bea-4bd4-8177-b20570d9cbf0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:56.872077 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-5a1f0a0a-2bea-4bd4-8177-b20570d9cbf0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:56.873943 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-5a1f0a0a-2bea-4bd4-8177-b20570d9cbf0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1807 microversion: 2.20 time: 0.153052 May 25 16:23:56.874522 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 219/432] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:56 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:57.789401 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-f1e83441-2569-4ab0-a684-564a2388548d req-d4830307-9075-46f0-9529-00bb39fc2dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3da72ce-f083-455e-ae40-9530c53126ef", "name": "network-vif-plugged", "status": "completed", "tag": "81d48be3-f76c-4118-bcaa-79360428da5a"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:23:57.799333 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-f1e83441-2569-4ab0-a684-564a2388548d req-d4830307-9075-46f0-9529-00bb39fc2dc0 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:57.799823 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-f1e83441-2569-4ab0-a684-564a2388548d req-d4830307-9075-46f0-9529-00bb39fc2dc0 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:57.813202 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-f1e83441-2569-4ab0-a684-564a2388548d req-d4830307-9075-46f0-9529-00bb39fc2dc0 service nova] Creating event network-vif-plugged:81d48be3-f76c-4118-bcaa-79360428da5a for instance d3da72ce-f083-455e-ae40-9530c53126ef on hv-cinder-84327 May 25 16:23:57.818418 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-f1e83441-2569-4ab0-a684-564a2388548d req-d4830307-9075-46f0-9529-00bb39fc2dc0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032922 May 25 16:23:57.819012 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 214/433] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:23:57.892795 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-65a2c09f-a56f-4bab-b9b8-c1ce195871b3 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:57.893363 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-65a2c09f-a56f-4bab-b9b8-c1ce195871b3 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:57.899547 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-65a2c09f-a56f-4bab-b9b8-c1ce195871b3 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:57.899993 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-65a2c09f-a56f-4bab-b9b8-c1ce195871b3 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:57.900746 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-65a2c09f-a56f-4bab-b9b8-c1ce195871b3 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:57.901179 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-65a2c09f-a56f-4bab-b9b8-c1ce195871b3 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:58.040946 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-65a2c09f-a56f-4bab-b9b8-c1ce195871b3 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:58.049353 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-65a2c09f-a56f-4bab-b9b8-c1ce195871b3 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:58.050888 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-65a2c09f-a56f-4bab-b9b8-c1ce195871b3 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:58.052036 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-65a2c09f-a56f-4bab-b9b8-c1ce195871b3 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1807 microversion: 2.20 time: 0.163636 May 25 16:23:58.052591 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 220/434] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:57 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:59.070545 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-7d0e75e6-bc13-46b0-948c-0c8128172ec6 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:59.071236 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-7d0e75e6-bc13-46b0-948c-0c8128172ec6 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:59.077881 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7d0e75e6-bc13-46b0-948c-0c8128172ec6 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:59.078330 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7d0e75e6-bc13-46b0-948c-0c8128172ec6 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:59.079088 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7d0e75e6-bc13-46b0-948c-0c8128172ec6 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:59.079521 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7d0e75e6-bc13-46b0-948c-0c8128172ec6 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:59.205171 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-7d0e75e6-bc13-46b0-948c-0c8128172ec6 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:59.213630 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-7d0e75e6-bc13-46b0-948c-0c8128172ec6 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:59.215533 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-7d0e75e6-bc13-46b0-948c-0c8128172ec6 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:59.216682 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-7d0e75e6-bc13-46b0-948c-0c8128172ec6 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1807 microversion: 2.20 time: 0.150348 May 25 16:23:59.218374 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 215/435] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:23:59 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:23:59.885015 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 16:23:59.885580 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Wed May 25 16:23:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 16:24:00.236462 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-05169b8e-959b-455f-a68d-f643e6a7dcf6 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:00.237103 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-05169b8e-959b-455f-a68d-f643e6a7dcf6 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:00.244933 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-05169b8e-959b-455f-a68d-f643e6a7dcf6 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:00.245701 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-05169b8e-959b-455f-a68d-f643e6a7dcf6 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:00.246998 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-05169b8e-959b-455f-a68d-f643e6a7dcf6 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:00.247712 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-05169b8e-959b-455f-a68d-f643e6a7dcf6 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:00.252636 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=84 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:24:00.386886 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-05169b8e-959b-455f-a68d-f643e6a7dcf6 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:00.395154 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-05169b8e-959b-455f-a68d-f643e6a7dcf6 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:00.396647 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-05169b8e-959b-455f-a68d-f643e6a7dcf6 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:00.397823 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-05169b8e-959b-455f-a68d-f643e6a7dcf6 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1807 microversion: 2.20 time: 0.166070 May 25 16:24:00.398373 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 221/436] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:24:00 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:24:01.415587 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-2d245113-8e4a-4829-9f9d-50715914abbb tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:01.416192 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-2d245113-8e4a-4829-9f9d-50715914abbb tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:01.422752 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2d245113-8e4a-4829-9f9d-50715914abbb tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:01.423204 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2d245113-8e4a-4829-9f9d-50715914abbb tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:01.423963 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2d245113-8e4a-4829-9f9d-50715914abbb tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:01.424401 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2d245113-8e4a-4829-9f9d-50715914abbb tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:01.552568 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-2d245113-8e4a-4829-9f9d-50715914abbb tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:01.561451 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-2d245113-8e4a-4829-9f9d-50715914abbb tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:01.563077 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-2d245113-8e4a-4829-9f9d-50715914abbb tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:01.564221 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-2d245113-8e4a-4829-9f9d-50715914abbb tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1807 microversion: 2.20 time: 0.152776 May 25 16:24:01.564782 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 216/437] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:24:01 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:24:02.583149 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-2eb2f296-1fa7-4a6e-95dd-c33b86d997a1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:02.583734 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-2eb2f296-1fa7-4a6e-95dd-c33b86d997a1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:02.590858 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2eb2f296-1fa7-4a6e-95dd-c33b86d997a1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:02.591310 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2eb2f296-1fa7-4a6e-95dd-c33b86d997a1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:02.593065 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2eb2f296-1fa7-4a6e-95dd-c33b86d997a1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:02.593543 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2eb2f296-1fa7-4a6e-95dd-c33b86d997a1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:02.728501 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-2eb2f296-1fa7-4a6e-95dd-c33b86d997a1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:02.737295 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-2eb2f296-1fa7-4a6e-95dd-c33b86d997a1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:02.738840 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-2eb2f296-1fa7-4a6e-95dd-c33b86d997a1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:02.739969 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-2eb2f296-1fa7-4a6e-95dd-c33b86d997a1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1794 microversion: 2.20 time: 0.160744 May 25 16:24:02.740507 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 222/438] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:24:02 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1794 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:24:21.325917 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-10ea6bab-ee2f-4a77-9ef6-04e75d4b6139 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d650010-f487-44a8-84e4-92ec565504b5"}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:24:21.327486 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-10ea6bab-ee2f-4a77-9ef6-04e75d4b6139 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:21.329827 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_api:SELECT=27 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:24:21.330472 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=51 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:24:21.336265 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-10ea6bab-ee2f-4a77-9ef6-04e75d4b6139 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:21.336711 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-10ea6bab-ee2f-4a77-9ef6-04e75d4b6139 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:21.337471 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-10ea6bab-ee2f-4a77-9ef6-04e75d4b6139 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:21.337945 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-10ea6bab-ee2f-4a77-9ef6-04e75d4b6139 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:21.586301 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-10ea6bab-ee2f-4a77-9ef6-04e75d4b6139 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "POST /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264210 May 25 16:24:21.586914 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 217/439] 10.222.0.42 () {60 vars in 1322 bytes} [Wed May 25 16:24:21 2022] POST /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:24:22.598222 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-d4233f25-80aa-40f6-84f9-5820d703a6ff tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:22.598792 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-d4233f25-80aa-40f6-84f9-5820d703a6ff tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 867f3a7b-7e7e-468a-b1a3-9c71cc196f23] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:22.600732 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_api:SELECT=11 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:24:22.601401 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=11 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:24:22.607467 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d4233f25-80aa-40f6-84f9-5820d703a6ff tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:22.608617 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d4233f25-80aa-40f6-84f9-5820d703a6ff tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:22.609471 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d4233f25-80aa-40f6-84f9-5820d703a6ff tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:22.609953 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d4233f25-80aa-40f6-84f9-5820d703a6ff tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:22.632395 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-d4233f25-80aa-40f6-84f9-5820d703a6ff tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23/ips" status: 200 len: 150 microversion: 2.1 time: 0.038054 May 25 16:24:22.632953 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 223/440] 10.222.0.42 () {58 vars in 1247 bytes} [Wed May 25 16:24:22 2022] GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:24:22.644619 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-f8e5249b-095a-4b59-b946-64f529e37201 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d1b758c-ccc9-47a3-ab27-c3eddd5bc169"}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:24:22.645788 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-f8e5249b-095a-4b59-b946-64f529e37201 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 867f3a7b-7e7e-468a-b1a3-9c71cc196f23] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:22.651970 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f8e5249b-095a-4b59-b946-64f529e37201 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:22.652547 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f8e5249b-095a-4b59-b946-64f529e37201 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:22.653172 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f8e5249b-095a-4b59-b946-64f529e37201 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:22.653610 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f8e5249b-095a-4b59-b946-64f529e37201 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:22.735142 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.wsgi [None req-f8e5249b-095a-4b59-b946-64f529e37201 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] HTTP exception thrown: Invalid volume: volume 0d1b758c-ccc9-47a3-ab27-c3eddd5bc169 is already attached to instances: cebf1f03-8c0a-4aaf-b375-63edcdac9d98 May 25 16:24:22.736909 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-f8e5249b-095a-4b59-b946-64f529e37201 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Request method failure captured: May 25 16:24:22.736909 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: request: POST /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23/os-volume_attachments HTTP/1.1 May 25 16:24:22.736909 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept: application/json May 25 16:24:22.736909 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept-Encoding: identity May 25 16:24:22.736909 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Connection: close May 25 16:24:22.736909 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Length: 74 May 25 16:24:22.736909 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Type: application/json May 25 16:24:22.736909 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Host: 10.222.0.42 May 25 16:24:22.736909 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Openstack-System-Scope: None May 25 16:24:22.736909 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: User-Agent: python-urllib3/1.26.9 May 25 16:24:22.736909 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Auth-Token: gAAAAABijldM9TsAZJy8dFB1DMOmN3fYD4FVUv3HZ7K9WxI11fcxXnHOFEKVQuqoz4pXUAyb9YMnHusiEz5_9NIfv66CxCRP6OYrV0TQFouqehYLNaYvAb5OzaoSF8oLgazxJMBBuxROCk5D-B6RTnZ7yadTSJVodvBMZSALenmgyavmYCv9RJ0 May 25 16:24:22.736909 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Id: None May 25 16:24:22.736909 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Name: None May 25 16:24:22.736909 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Identity-Status: Confirmed May 25 16:24:22.736909 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Is-Admin-Project: True May 25 16:24:22.736909 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Id: default May 25 16:24:22.736909 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Name: Default May 25 16:24:22.736909 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Id: 9d234edace28441282f594f0e03cacc5 May 25 16:24:22.736909 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Name: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:24:22.736909 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Role: reader,member May 25 16:24:22.736909 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Roles: reader,member May 25 16:24:22.738495 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d234edace28441282f594f0e03cacc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d234edace28441282f594f0e03cacc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d234edace28441282f594f0e03cacc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d234edace28441282f594f0e03cacc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:24:22.738495 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:24:22.738495 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Id: 9d234edace28441282f594f0e03cacc5 May 25 16:24:22.738495 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:24:22.738495 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User: tempest-AttachVolumeNegativeTest-1719621589-project May 25 16:24:22.738495 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Id: default May 25 16:24:22.738495 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Name: Default May 25 16:24:22.738495 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Id: b781c4c6cb61439fb781988a7da028ff May 25 16:24:22.738495 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Name: tempest-AttachVolumeNegativeTest-1719621589-project May 25 16:24:22.738495 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: May 25 16:24:22.738495 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: {"volumeAttachment": {"volumeId": "0d1b758c-ccc9-47a3-ab27-c3eddd5bc169"}} May 25 16:24:22.738495 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: method: > May 25 16:24:22.739452 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: exception: Invalid volume: volume 0d1b758c-ccc9-47a3-ab27-c3eddd5bc169 is already attached to instances: cebf1f03-8c0a-4aaf-b375-63edcdac9d98 May 25 16:24:22.739452 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: action_args: {'server_id': '867f3a7b-7e7e-468a-b1a3-9c71cc196f23', 'body': {'volumeAttachment': {'volumeId': '0d1b758c-ccc9-47a3-ab27-c3eddd5bc169'}}} May 25 16:24:22.739452 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:24:22.739452 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:24:22.739452 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 25 16:24:22.739452 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 25 16:24:22.739452 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 25 16:24:22.739452 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 25 16:24:22.739452 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 25 16:24:22.739452 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 25 16:24:22.739452 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 25 16:24:22.739452 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 25 16:24:22.739452 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 25 16:24:22.739452 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 25 16:24:22.739452 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0d1b758c-ccc9-47a3-ab27-c3eddd5bc169 is already attached to instances: cebf1f03-8c0a-4aaf-b375-63edcdac9d98 May 25 16:24:22.739452 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:24:22.739452 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:24:22.739452 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:24:22.739452 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:24:22.740972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:24:22.740972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:24:22.740972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:24:22.740972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:24:22.740972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:24:22.740972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:24:22.740972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 16:24:22.740972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 16:24:22.740972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 16:24:22.740972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 16:24:22.740972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 16:24:22.740972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 16:24:22.740972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 25 16:24:22.740972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 25 16:24:22.740972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0d1b758c-ccc9-47a3-ab27-c3eddd5bc169 is already attached to instances: cebf1f03-8c0a-4aaf-b375-63edcdac9d98 May 25 16:24:22.740972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:24:22.740972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:24:22.740972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:24:22.740972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:24:22.740972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:24:22.742444 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:24:22.742444 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:24:22.742444 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:24:22.742444 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0d1b758c-ccc9-47a3-ab27-c3eddd5bc169 is already attached to instances: cebf1f03-8c0a-4aaf-b375-63edcdac9d98 May 25 16:24:22.742444 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:24:22.742444 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-f8e5249b-095a-4b59-b946-64f529e37201 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Returning 400 to user: Invalid volume: volume 0d1b758c-ccc9-47a3-ab27-c3eddd5bc169 is already attached to instances: cebf1f03-8c0a-4aaf-b375-63edcdac9d98 {{(pid=117510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:24:22.742444 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-f8e5249b-095a-4b59-b946-64f529e37201 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "POST /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098639 May 25 16:24:22.742444 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 218/441] 10.222.0.42 () {60 vars in 1322 bytes} [Wed May 25 16:24:22 2022] POST /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 25 16:24:22.748376 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-8c63decc-b952-417a-b5d9-3d1f695f1272 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:22.749256 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-8c63decc-b952-417a-b5d9-3d1f695f1272 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 867f3a7b-7e7e-468a-b1a3-9c71cc196f23] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:22.755415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8c63decc-b952-417a-b5d9-3d1f695f1272 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:22.755862 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8c63decc-b952-417a-b5d9-3d1f695f1272 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:22.756617 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8c63decc-b952-417a-b5d9-3d1f695f1272 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:22.757050 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8c63decc-b952-417a-b5d9-3d1f695f1272 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:22.784307 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-8c63decc-b952-417a-b5d9-3d1f695f1272 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 867f3a7b-7e7e-468a-b1a3-9c71cc196f23] Going to try to terminate instance {{(pid=117509) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:24:22.874040 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-8c63decc-b952-417a-b5d9-3d1f695f1272 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "DELETE /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23" status: 204 len: 0 microversion: 2.1 time: 0.129142 May 25 16:24:22.874935 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 224/442] 10.222.0.42 () {58 vars in 1238 bytes} [Wed May 25 16:24:22 2022] DELETE /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 25 16:24:22.883674 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-6646a099-d83b-4b98-9cdf-d8b90f25dd61 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:22.884284 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-6646a099-d83b-4b98-9cdf-d8b90f25dd61 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 867f3a7b-7e7e-468a-b1a3-9c71cc196f23] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:22.892143 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6646a099-d83b-4b98-9cdf-d8b90f25dd61 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:22.892587 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6646a099-d83b-4b98-9cdf-d8b90f25dd61 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:22.893359 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6646a099-d83b-4b98-9cdf-d8b90f25dd61 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:22.893842 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6646a099-d83b-4b98-9cdf-d8b90f25dd61 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:23.022555 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-6646a099-d83b-4b98-9cdf-d8b90f25dd61 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:23.030570 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-6646a099-d83b-4b98-9cdf-d8b90f25dd61 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23" status: 200 len: 1682 microversion: 2.1 time: 0.150321 May 25 16:24:23.031126 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 219/443] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:22 2022] GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:24.050656 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-f4fc560f-aff1-4864-af71-36ef2372c729 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:24.051312 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-f4fc560f-aff1-4864-af71-36ef2372c729 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 867f3a7b-7e7e-468a-b1a3-9c71cc196f23] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:24.057288 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f4fc560f-aff1-4864-af71-36ef2372c729 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:24.057751 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f4fc560f-aff1-4864-af71-36ef2372c729 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:24.058516 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f4fc560f-aff1-4864-af71-36ef2372c729 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:24.058945 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f4fc560f-aff1-4864-af71-36ef2372c729 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:24.184421 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-f4fc560f-aff1-4864-af71-36ef2372c729 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:24.191878 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-f4fc560f-aff1-4864-af71-36ef2372c729 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23" status: 200 len: 1682 microversion: 2.1 time: 0.145596 May 25 16:24:24.192432 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 225/444] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:24 2022] GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23 => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:25.209625 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-35fd8edd-3c6e-40af-b9c8-7a24a3e03d09 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:25.210708 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-35fd8edd-3c6e-40af-b9c8-7a24a3e03d09 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 867f3a7b-7e7e-468a-b1a3-9c71cc196f23] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:25.216687 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-35fd8edd-3c6e-40af-b9c8-7a24a3e03d09 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:25.217224 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-35fd8edd-3c6e-40af-b9c8-7a24a3e03d09 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:25.218283 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-35fd8edd-3c6e-40af-b9c8-7a24a3e03d09 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:25.218713 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-35fd8edd-3c6e-40af-b9c8-7a24a3e03d09 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:25.359170 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-35fd8edd-3c6e-40af-b9c8-7a24a3e03d09 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:25.372430 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-35fd8edd-3c6e-40af-b9c8-7a24a3e03d09 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23" status: 200 len: 1682 microversion: 2.1 time: 0.166353 May 25 16:24:25.374192 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 220/445] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:25 2022] GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:25.887188 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-3403dec6-6a1c-49f5-9684-a4d019e8f751 req-2e71d22b-bed2-4aed-83a9-bf8e5289f7d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "867f3a7b-7e7e-468a-b1a3-9c71cc196f23", "name": "network-vif-deleted", "tag": "6671911c-5350-4820-bfd8-8e86bc7f1151"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:24:25.898180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-3403dec6-6a1c-49f5-9684-a4d019e8f751 req-2e71d22b-bed2-4aed-83a9-bf8e5289f7d4 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:25.898618 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-3403dec6-6a1c-49f5-9684-a4d019e8f751 req-2e71d22b-bed2-4aed-83a9-bf8e5289f7d4 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:25.914867 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-3403dec6-6a1c-49f5-9684-a4d019e8f751 req-2e71d22b-bed2-4aed-83a9-bf8e5289f7d4 service nova] Creating event network-vif-deleted:6671911c-5350-4820-bfd8-8e86bc7f1151 for instance 867f3a7b-7e7e-468a-b1a3-9c71cc196f23 on hv-cinder-84327 May 25 16:24:25.922352 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-3403dec6-6a1c-49f5-9684-a4d019e8f751 req-2e71d22b-bed2-4aed-83a9-bf8e5289f7d4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038720 May 25 16:24:25.923721 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 226/446] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:24:26.391271 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-3a5038ad-9250-4d70-9850-c5d7c96d52e5 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:26.391874 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-3a5038ad-9250-4d70-9850-c5d7c96d52e5 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 867f3a7b-7e7e-468a-b1a3-9c71cc196f23] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:26.398607 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3a5038ad-9250-4d70-9850-c5d7c96d52e5 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:26.399387 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3a5038ad-9250-4d70-9850-c5d7c96d52e5 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:26.400170 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3a5038ad-9250-4d70-9850-c5d7c96d52e5 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:26.400618 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3a5038ad-9250-4d70-9850-c5d7c96d52e5 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:26.449033 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3a5038ad-9250-4d70-9850-c5d7c96d52e5 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:26.449483 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3a5038ad-9250-4d70-9850-c5d7c96d52e5 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:26.450010 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.objects.instance [None req-3a5038ad-9250-4d70-9850-c5d7c96d52e5 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lazy-loading 'fault' on Instance uuid 867f3a7b-7e7e-468a-b1a3-9c71cc196f23 {{(pid=117510) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:24:26.500351 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-3a5038ad-9250-4d70-9850-c5d7c96d52e5 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:26.514827 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-3a5038ad-9250-4d70-9850-c5d7c96d52e5 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23" status: 200 len: 1331 microversion: 2.1 time: 0.127014 May 25 16:24:26.516334 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 221/447] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:26 2022] GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23 => generated 1331 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:27.533512 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-49980322-e85d-4630-ad63-60985cf4593f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:27.534252 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-49980322-e85d-4630-ad63-60985cf4593f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 867f3a7b-7e7e-468a-b1a3-9c71cc196f23] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:27.540791 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-49980322-e85d-4630-ad63-60985cf4593f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:27.541239 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-49980322-e85d-4630-ad63-60985cf4593f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:27.542034 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-49980322-e85d-4630-ad63-60985cf4593f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:27.542464 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-49980322-e85d-4630-ad63-60985cf4593f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:27.556207 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.wsgi [None req-49980322-e85d-4630-ad63-60985cf4593f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] HTTP exception thrown: Instance 867f3a7b-7e7e-468a-b1a3-9c71cc196f23 could not be found. May 25 16:24:27.557841 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-49980322-e85d-4630-ad63-60985cf4593f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Request method failure captured: May 25 16:24:27.557841 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23 HTTP/1.1 May 25 16:24:27.557841 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:24:27.557841 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:24:27.557841 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:24:27.557841 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 0 May 25 16:24:27.557841 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:24:27.557841 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:24:27.557841 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:24:27.557841 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:24:27.557841 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijldM9TsAZJy8dFB1DMOmN3fYD4FVUv3HZ7K9WxI11fcxXnHOFEKVQuqoz4pXUAyb9YMnHusiEz5_9NIfv66CxCRP6OYrV0TQFouqehYLNaYvAb5OzaoSF8oLgazxJMBBuxROCk5D-B6RTnZ7yadTSJVodvBMZSALenmgyavmYCv9RJ0 May 25 16:24:27.557841 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:24:27.557841 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:24:27.557841 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:24:27.557841 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:24:27.557841 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:24:27.557841 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:24:27.557841 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: 9d234edace28441282f594f0e03cacc5 May 25 16:24:27.557841 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:24:27.557841 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:24:27.557841 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:24:27.559191 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d234edace28441282f594f0e03cacc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d234edace28441282f594f0e03cacc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d234edace28441282f594f0e03cacc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d234edace28441282f594f0e03cacc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:24:27.559191 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:24:27.559191 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: 9d234edace28441282f594f0e03cacc5 May 25 16:24:27.559191 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:24:27.559191 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-AttachVolumeNegativeTest-1719621589-project May 25 16:24:27.559191 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:24:27.559191 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:24:27.559191 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: b781c4c6cb61439fb781988a7da028ff May 25 16:24:27.559191 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-AttachVolumeNegativeTest-1719621589-project May 25 16:24:27.559191 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: > May 25 16:24:27.559191 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Instance 867f3a7b-7e7e-468a-b1a3-9c71cc196f23 could not be found. May 25 16:24:27.559191 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'id': '867f3a7b-7e7e-468a-b1a3-9c71cc196f23'} May 25 16:24:27.559891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:24:27.559891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:24:27.559891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:24:27.559891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:24:27.559891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:24:27.559891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:24:27.559891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:24:27.559891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:24:27.559891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:24:27.559891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:24:27.559891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 867f3a7b-7e7e-468a-b1a3-9c71cc196f23 could not be found. May 25 16:24:27.559891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:24:27.559891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:24:27.559891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:24:27.559891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:24:27.559891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:24:27.559891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:24:27.559891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:24:27.559891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:24:27.559891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:24:27.562050 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:24:27.562050 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:24:27.562050 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:24:27.562050 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:24:27.562050 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:24:27.562050 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:24:27.562050 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:24:27.562050 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 867f3a7b-7e7e-468a-b1a3-9c71cc196f23 could not be found. May 25 16:24:27.562050 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:24:27.562050 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:24:27.562050 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:24:27.562050 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:24:27.562050 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:24:27.562050 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:24:27.562050 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:24:27.562050 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:24:27.562050 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 867f3a7b-7e7e-468a-b1a3-9c71cc196f23 could not be found. May 25 16:24:27.562050 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:24:27.563116 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-49980322-e85d-4630-ad63-60985cf4593f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Returning 404 to user: Instance 867f3a7b-7e7e-468a-b1a3-9c71cc196f23 could not be found. {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:24:27.563116 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-49980322-e85d-4630-ad63-60985cf4593f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23" status: 404 len: 111 microversion: 2.1 time: 0.030060 May 25 16:24:27.563116 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 227/448] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:27 2022] GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:24:27.568697 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-3ef395b6-19b8-4c99-8580-fd9c19538481 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '.version_select at 0x7f51ed9703a0>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:27.587061 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-3ef395b6-19b8-4c99-8580-fd9c19538481 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1795382636" status: 202 len: 0 microversion: 2.1 time: 0.022089 May 25 16:24:27.587626 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 222/449] 10.222.0.42 () {58 vars in 1220 bytes} [Wed May 25 16:24:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1795382636 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:24:28.300272 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-3f449799-cfcd-46c4-a854-71448a8cf178 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:28.300905 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-3f449799-cfcd-46c4-a854-71448a8cf178 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:28.308128 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3f449799-cfcd-46c4-a854-71448a8cf178 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:28.308533 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3f449799-cfcd-46c4-a854-71448a8cf178 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:28.309583 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3f449799-cfcd-46c4-a854-71448a8cf178 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:28.310144 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3f449799-cfcd-46c4-a854-71448a8cf178 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:28.448505 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.objects.instance [None req-3f449799-cfcd-46c4-a854-71448a8cf178 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lazy-loading 'services' on Instance uuid cebf1f03-8c0a-4aaf-b375-63edcdac9d98 {{(pid=117509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:24:28.565275 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-3f449799-cfcd-46c4-a854-71448a8cf178 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98/os-volume_attachments/0d1b758c-ccc9-47a3-ab27-c3eddd5bc169" status: 202 len: 0 microversion: 2.1 time: 0.269980 May 25 16:24:28.565910 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 228/450] 10.222.0.42 () {58 vars in 1415 bytes} [Wed May 25 16:24:28 2022] DELETE /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98/os-volume_attachments/0d1b758c-ccc9-47a3-ab27-c3eddd5bc169 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:24:28.575066 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-ec13f01b-25d2-4e6b-913f-8592f89c48c3 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:28.575990 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-ec13f01b-25d2-4e6b-913f-8592f89c48c3 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:28.584085 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ec13f01b-25d2-4e6b-913f-8592f89c48c3 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:28.584574 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ec13f01b-25d2-4e6b-913f-8592f89c48c3 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:28.585580 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ec13f01b-25d2-4e6b-913f-8592f89c48c3 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:28.586065 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ec13f01b-25d2-4e6b-913f-8592f89c48c3 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:28.616512 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-ec13f01b-25d2-4e6b-913f-8592f89c48c3 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045409 May 25 16:24:28.617070 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 223/451] 10.222.0.42 () {58 vars in 1301 bytes} [Wed May 25 16:24:28 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:24:28.841056 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-2f243f01-b6c4-4864-9321-babe43b92ef4 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:28.841804 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-2f243f01-b6c4-4864-9321-babe43b92ef4 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:28.848939 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2f243f01-b6c4-4864-9321-babe43b92ef4 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:28.849385 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2f243f01-b6c4-4864-9321-babe43b92ef4 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:28.850224 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2f243f01-b6c4-4864-9321-babe43b92ef4 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:28.850676 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2f243f01-b6c4-4864-9321-babe43b92ef4 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:28.935665 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.objects.instance [None req-2f243f01-b6c4-4864-9321-babe43b92ef4 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lazy-loading 'services' on Instance uuid 9c525fad-3e59-4bcd-9263-cf3a13d13e3f {{(pid=117509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:24:29.007800 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-2f243f01-b6c4-4864-9321-babe43b92ef4 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f/os-volume_attachments/6f3f968b-3f2d-4620-8169-a8c52db84c27" status: 202 len: 0 microversion: 2.1 time: 0.171288 May 25 16:24:29.008387 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 229/452] 10.222.0.42 () {58 vars in 1415 bytes} [Wed May 25 16:24:28 2022] DELETE /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f/os-volume_attachments/6f3f968b-3f2d-4620-8169-a8c52db84c27 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:24:29.114716 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-b2879b46-28e4-43fd-8a08-b854d3364844 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:24:29.115748 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-b2879b46-28e4-43fd-8a08-b854d3364844 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:29.121649 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b2879b46-28e4-43fd-8a08-b854d3364844 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:29.122137 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b2879b46-28e4-43fd-8a08-b854d3364844 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:29.122899 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b2879b46-28e4-43fd-8a08-b854d3364844 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:29.123862 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b2879b46-28e4-43fd-8a08-b854d3364844 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:29.146201 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.objects.instance [None req-b2879b46-28e4-43fd-8a08-b854d3364844 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lazy-loading 'flavor' on Instance uuid f68f3730-3984-4aef-9c58-e87b09051c87 {{(pid=117510) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:24:29.302451 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-b2879b46-28e4-43fd-8a08-b854d3364844 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "POST /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87/action" status: 200 len: 32 microversion: 2.1 time: 0.191696 May 25 16:24:29.303045 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 224/453] 10.222.0.42 () {60 vars in 1277 bytes} [Wed May 25 16:24:29 2022] POST /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87/action => generated 32 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 16:24:29.314686 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-fe298d35-97bf-4895-a923-f80466b15f2f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:29.315299 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-fe298d35-97bf-4895-a923-f80466b15f2f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:29.323692 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fe298d35-97bf-4895-a923-f80466b15f2f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:29.324628 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fe298d35-97bf-4895-a923-f80466b15f2f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:29.325759 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fe298d35-97bf-4895-a923-f80466b15f2f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:29.327483 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fe298d35-97bf-4895-a923-f80466b15f2f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:29.474861 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-fe298d35-97bf-4895-a923-f80466b15f2f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:29.483083 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-fe298d35-97bf-4895-a923-f80466b15f2f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1733 microversion: 2.1 time: 0.174623 May 25 16:24:29.483660 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 230/454] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:29 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1733 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:29.629051 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-c4c9bac9-bd14-4bdc-96b7-f5b900c19fcf tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:29.630102 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-c4c9bac9-bd14-4bdc-96b7-f5b900c19fcf tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:29.636809 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c4c9bac9-bd14-4bdc-96b7-f5b900c19fcf tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:29.637256 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c4c9bac9-bd14-4bdc-96b7-f5b900c19fcf tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:29.638046 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c4c9bac9-bd14-4bdc-96b7-f5b900c19fcf tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:29.638479 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c4c9bac9-bd14-4bdc-96b7-f5b900c19fcf tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:29.667526 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-c4c9bac9-bd14-4bdc-96b7-f5b900c19fcf tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043256 May 25 16:24:29.668068 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 225/455] 10.222.0.42 () {58 vars in 1301 bytes} [Wed May 25 16:24:29 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:24:30.500488 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-2bd30b53-0e98-47b2-88e1-1776ea67eb15 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:30.501496 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-2bd30b53-0e98-47b2-88e1-1776ea67eb15 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:30.508639 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2bd30b53-0e98-47b2-88e1-1776ea67eb15 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:30.509571 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2bd30b53-0e98-47b2-88e1-1776ea67eb15 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:30.510364 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2bd30b53-0e98-47b2-88e1-1776ea67eb15 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:30.510780 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2bd30b53-0e98-47b2-88e1-1776ea67eb15 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:30.636650 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-2bd30b53-0e98-47b2-88e1-1776ea67eb15 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:30.645091 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-2bd30b53-0e98-47b2-88e1-1776ea67eb15 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1733 microversion: 2.1 time: 0.149249 May 25 16:24:30.645650 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 231/456] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:30 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:24:30.678970 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-7d74fd56-04a9-4a97-aaef-ad6e9e0b0709 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:30.679901 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-7d74fd56-04a9-4a97-aaef-ad6e9e0b0709 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:30.687076 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7d74fd56-04a9-4a97-aaef-ad6e9e0b0709 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:30.687523 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7d74fd56-04a9-4a97-aaef-ad6e9e0b0709 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:30.688284 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7d74fd56-04a9-4a97-aaef-ad6e9e0b0709 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:30.688724 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7d74fd56-04a9-4a97-aaef-ad6e9e0b0709 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:30.716477 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-7d74fd56-04a9-4a97-aaef-ad6e9e0b0709 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041414 May 25 16:24:30.717106 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 226/457] 10.222.0.42 () {58 vars in 1301 bytes} [Wed May 25 16:24:30 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 16:24:30.775190 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-34d8a860-33f0-4879-bed3-5fee5836f52f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:30.775713 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-34d8a860-33f0-4879-bed3-5fee5836f52f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:30.781565 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-34d8a860-33f0-4879-bed3-5fee5836f52f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:30.782035 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-34d8a860-33f0-4879-bed3-5fee5836f52f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:30.782789 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-34d8a860-33f0-4879-bed3-5fee5836f52f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:30.783223 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-34d8a860-33f0-4879-bed3-5fee5836f52f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:30.807147 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-34d8a860-33f0-4879-bed3-5fee5836f52f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Going to try to terminate instance {{(pid=117509) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:24:30.886118 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-34d8a860-33f0-4879-bed3-5fee5836f52f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98" status: 204 len: 0 microversion: 2.1 time: 0.114037 May 25 16:24:30.887571 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 232/458] 10.222.0.42 () {58 vars in 1238 bytes} [Wed May 25 16:24:30 2022] DELETE /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:24:30.896280 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-e0481d64-708c-4d8f-bb53-e2a25ba4f130 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:30.896922 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-e0481d64-708c-4d8f-bb53-e2a25ba4f130 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:30.902725 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e0481d64-708c-4d8f-bb53-e2a25ba4f130 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:30.903167 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e0481d64-708c-4d8f-bb53-e2a25ba4f130 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:30.903913 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e0481d64-708c-4d8f-bb53-e2a25ba4f130 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:30.904396 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e0481d64-708c-4d8f-bb53-e2a25ba4f130 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:31.037596 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-e0481d64-708c-4d8f-bb53-e2a25ba4f130 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:31.045499 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-e0481d64-708c-4d8f-bb53-e2a25ba4f130 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98" status: 200 len: 1683 microversion: 2.1 time: 0.152521 May 25 16:24:31.046087 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 227/459] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:30 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:31.189461 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-b08e4888-a6f8-4942-a955-3efa2c872d5a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:24:31.195398 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b08e4888-a6f8-4942-a955-3efa2c872d5a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:31.195864 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b08e4888-a6f8-4942-a955-3efa2c872d5a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:31.225031 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-b08e4888-a6f8-4942-a955-3efa2c872d5a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Going to try to stop instance {{(pid=117509) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 25 16:24:31.265900 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-b08e4888-a6f8-4942-a955-3efa2c872d5a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "POST /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f/action" status: 202 len: 0 microversion: 2.1 time: 0.081072 May 25 16:24:31.266488 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 233/460] 10.222.0.42 () {60 vars in 1277 bytes} [Wed May 25 16:24:31 2022] POST /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:24:31.274408 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-b472f3bc-3425-4618-815b-5d6bc708358c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:31.275022 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-b472f3bc-3425-4618-815b-5d6bc708358c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:31.281047 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b472f3bc-3425-4618-815b-5d6bc708358c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:31.281495 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b472f3bc-3425-4618-815b-5d6bc708358c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:31.282292 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b472f3bc-3425-4618-815b-5d6bc708358c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:31.282731 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b472f3bc-3425-4618-815b-5d6bc708358c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:31.409692 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-b472f3bc-3425-4618-815b-5d6bc708358c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:31.417274 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-b472f3bc-3425-4618-815b-5d6bc708358c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1677 microversion: 2.1 time: 0.146639 May 25 16:24:31.418590 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 228/461] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:31 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:31.663131 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-f21b47dc-283d-4766-95aa-4e5ddb9732e5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:31.663732 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-f21b47dc-283d-4766-95aa-4e5ddb9732e5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:31.670959 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f21b47dc-283d-4766-95aa-4e5ddb9732e5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:31.671468 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f21b47dc-283d-4766-95aa-4e5ddb9732e5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:31.672255 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f21b47dc-283d-4766-95aa-4e5ddb9732e5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:31.672681 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f21b47dc-283d-4766-95aa-4e5ddb9732e5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:31.800664 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-f21b47dc-283d-4766-95aa-4e5ddb9732e5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:31.808860 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-f21b47dc-283d-4766-95aa-4e5ddb9732e5 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1733 microversion: 2.1 time: 0.150268 May 25 16:24:31.809414 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 234/462] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:31 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:32.062672 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-5b691cda-b0a7-418d-90ca-c5fc22f51c68 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:32.063289 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-5b691cda-b0a7-418d-90ca-c5fc22f51c68 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:32.069865 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5b691cda-b0a7-418d-90ca-c5fc22f51c68 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:32.070317 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5b691cda-b0a7-418d-90ca-c5fc22f51c68 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:32.071086 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5b691cda-b0a7-418d-90ca-c5fc22f51c68 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:32.071543 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5b691cda-b0a7-418d-90ca-c5fc22f51c68 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:32.198674 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-5b691cda-b0a7-418d-90ca-c5fc22f51c68 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:32.206877 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-5b691cda-b0a7-418d-90ca-c5fc22f51c68 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98" status: 200 len: 1683 microversion: 2.1 time: 0.148675 May 25 16:24:32.207443 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 229/463] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:32 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:32.436594 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-20d0075e-bed6-4b65-bc4b-a09c7a4a41a9 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:32.437226 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-20d0075e-bed6-4b65-bc4b-a09c7a4a41a9 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:32.443361 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-20d0075e-bed6-4b65-bc4b-a09c7a4a41a9 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:32.443804 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-20d0075e-bed6-4b65-bc4b-a09c7a4a41a9 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:32.444577 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-20d0075e-bed6-4b65-bc4b-a09c7a4a41a9 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:32.445004 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-20d0075e-bed6-4b65-bc4b-a09c7a4a41a9 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:32.466533 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=5 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:24:32.586557 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-20d0075e-bed6-4b65-bc4b-a09c7a4a41a9 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:32.594435 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-20d0075e-bed6-4b65-bc4b-a09c7a4a41a9 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1677 microversion: 2.1 time: 0.162201 May 25 16:24:32.595112 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 235/464] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:32 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:32.827228 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-815ae1c8-3a59-4d10-8fa1-819c1ccc9122 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:32.827866 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-815ae1c8-3a59-4d10-8fa1-819c1ccc9122 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:32.833951 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-815ae1c8-3a59-4d10-8fa1-819c1ccc9122 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:32.834403 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-815ae1c8-3a59-4d10-8fa1-819c1ccc9122 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:32.835157 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-815ae1c8-3a59-4d10-8fa1-819c1ccc9122 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:32.835599 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-815ae1c8-3a59-4d10-8fa1-819c1ccc9122 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:32.971464 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-815ae1c8-3a59-4d10-8fa1-819c1ccc9122 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:32.975132 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:24:32.980839 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-815ae1c8-3a59-4d10-8fa1-819c1ccc9122 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1733 microversion: 2.1 time: 0.158334 May 25 16:24:32.981626 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 230/465] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:32 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:33.230369 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-6cb2766c-ea5f-4292-8130-d8c73cbc2688 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:33.231119 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-6cb2766c-ea5f-4292-8130-d8c73cbc2688 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:33.239354 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6cb2766c-ea5f-4292-8130-d8c73cbc2688 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:33.239835 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6cb2766c-ea5f-4292-8130-d8c73cbc2688 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:33.240880 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6cb2766c-ea5f-4292-8130-d8c73cbc2688 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:33.241429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6cb2766c-ea5f-4292-8130-d8c73cbc2688 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:33.381149 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-6cb2766c-ea5f-4292-8130-d8c73cbc2688 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:33.389982 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-6cb2766c-ea5f-4292-8130-d8c73cbc2688 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98" status: 200 len: 1683 microversion: 2.1 time: 0.169507 May 25 16:24:33.390784 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 236/466] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:33 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:33.612076 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-37174e16-3279-40e2-9757-d9fb80c8d0f1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:33.612696 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-37174e16-3279-40e2-9757-d9fb80c8d0f1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:33.620287 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-37174e16-3279-40e2-9757-d9fb80c8d0f1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:33.620733 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-37174e16-3279-40e2-9757-d9fb80c8d0f1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:33.621557 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-37174e16-3279-40e2-9757-d9fb80c8d0f1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:33.621954 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-37174e16-3279-40e2-9757-d9fb80c8d0f1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:33.687298 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-3cbdcf07-2b61-4fd6-ad25-c32d0bcc5c16 req-cbee8d8b-f9b4-433f-86b7-82a88a4b0394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cebf1f03-8c0a-4aaf-b375-63edcdac9d98", "name": "network-vif-deleted", "tag": "a5479e6d-c810-409e-9dcb-42725ffdaeea"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:24:33.723123 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-3cbdcf07-2b61-4fd6-ad25-c32d0bcc5c16 req-cbee8d8b-f9b4-433f-86b7-82a88a4b0394 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:33.725202 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-3cbdcf07-2b61-4fd6-ad25-c32d0bcc5c16 req-cbee8d8b-f9b4-433f-86b7-82a88a4b0394 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:33.751764 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-3cbdcf07-2b61-4fd6-ad25-c32d0bcc5c16 req-cbee8d8b-f9b4-433f-86b7-82a88a4b0394 service nova] Creating event network-vif-deleted:a5479e6d-c810-409e-9dcb-42725ffdaeea for instance cebf1f03-8c0a-4aaf-b375-63edcdac9d98 on hv-cinder-84327 May 25 16:24:33.757277 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-3cbdcf07-2b61-4fd6-ad25-c32d0bcc5c16 req-cbee8d8b-f9b4-433f-86b7-82a88a4b0394 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074841 May 25 16:24:33.762577 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 237/467] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:24:33.797094 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-37174e16-3279-40e2-9757-d9fb80c8d0f1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:33.806630 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-37174e16-3279-40e2-9757-d9fb80c8d0f1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1677 microversion: 2.1 time: 0.198449 May 25 16:24:33.810806 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 231/468] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:33 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1677 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:33.999573 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-a33ef6d0-77f2-45e4-9acb-3c2c938925d3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:34.000254 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-a33ef6d0-77f2-45e4-9acb-3c2c938925d3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:34.007078 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a33ef6d0-77f2-45e4-9acb-3c2c938925d3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:34.007547 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a33ef6d0-77f2-45e4-9acb-3c2c938925d3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:34.008300 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a33ef6d0-77f2-45e4-9acb-3c2c938925d3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:34.008732 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a33ef6d0-77f2-45e4-9acb-3c2c938925d3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:34.136261 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-a33ef6d0-77f2-45e4-9acb-3c2c938925d3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:34.144748 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-a33ef6d0-77f2-45e4-9acb-3c2c938925d3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1733 microversion: 2.1 time: 0.149804 May 25 16:24:34.144904 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 238/469] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:33 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:34.407685 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-e29a0863-b05c-4445-b9ef-f957f8f7c152 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:34.408284 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-e29a0863-b05c-4445-b9ef-f957f8f7c152 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:34.414639 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e29a0863-b05c-4445-b9ef-f957f8f7c152 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:34.415081 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e29a0863-b05c-4445-b9ef-f957f8f7c152 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:34.415840 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e29a0863-b05c-4445-b9ef-f957f8f7c152 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:34.416270 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e29a0863-b05c-4445-b9ef-f957f8f7c152 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:34.429843 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.wsgi [None req-e29a0863-b05c-4445-b9ef-f957f8f7c152 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] HTTP exception thrown: Instance cebf1f03-8c0a-4aaf-b375-63edcdac9d98 could not be found. May 25 16:24:34.431517 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-e29a0863-b05c-4445-b9ef-f957f8f7c152 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Request method failure captured: May 25 16:24:34.431517 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: request: GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 HTTP/1.1 May 25 16:24:34.431517 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept: application/json May 25 16:24:34.431517 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept-Encoding: identity May 25 16:24:34.431517 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Connection: close May 25 16:24:34.431517 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Length: 0 May 25 16:24:34.431517 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Type: application/json May 25 16:24:34.431517 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Host: 10.222.0.42 May 25 16:24:34.431517 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Openstack-System-Scope: None May 25 16:24:34.431517 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: User-Agent: python-urllib3/1.26.9 May 25 16:24:34.431517 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Auth-Token: gAAAAABijldM9TsAZJy8dFB1DMOmN3fYD4FVUv3HZ7K9WxI11fcxXnHOFEKVQuqoz4pXUAyb9YMnHusiEz5_9NIfv66CxCRP6OYrV0TQFouqehYLNaYvAb5OzaoSF8oLgazxJMBBuxROCk5D-B6RTnZ7yadTSJVodvBMZSALenmgyavmYCv9RJ0 May 25 16:24:34.431517 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Id: None May 25 16:24:34.431517 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Name: None May 25 16:24:34.431517 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Identity-Status: Confirmed May 25 16:24:34.431517 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Is-Admin-Project: True May 25 16:24:34.431517 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Id: default May 25 16:24:34.431517 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Name: Default May 25 16:24:34.431517 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Id: 9d234edace28441282f594f0e03cacc5 May 25 16:24:34.431517 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Name: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:24:34.431517 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Role: reader,member May 25 16:24:34.431517 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Roles: reader,member May 25 16:24:34.432814 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d234edace28441282f594f0e03cacc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d234edace28441282f594f0e03cacc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d234edace28441282f594f0e03cacc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d234edace28441282f594f0e03cacc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:24:34.432814 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:24:34.432814 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Id: 9d234edace28441282f594f0e03cacc5 May 25 16:24:34.432814 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:24:34.432814 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User: tempest-AttachVolumeNegativeTest-1719621589-project May 25 16:24:34.432814 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Id: default May 25 16:24:34.432814 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Name: Default May 25 16:24:34.432814 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Id: b781c4c6cb61439fb781988a7da028ff May 25 16:24:34.432814 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Name: tempest-AttachVolumeNegativeTest-1719621589-project May 25 16:24:34.432814 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: method: > May 25 16:24:34.432814 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: exception: Instance cebf1f03-8c0a-4aaf-b375-63edcdac9d98 could not be found. May 25 16:24:34.432814 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: action_args: {'id': 'cebf1f03-8c0a-4aaf-b375-63edcdac9d98'} May 25 16:24:34.434216 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:24:34.434216 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:24:34.434216 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:24:34.434216 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:24:34.434216 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:24:34.434216 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:24:34.434216 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:24:34.434216 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:24:34.434216 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:24:34.434216 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:24:34.434216 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cebf1f03-8c0a-4aaf-b375-63edcdac9d98 could not be found. May 25 16:24:34.434216 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:24:34.434216 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:24:34.434216 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:24:34.434216 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:24:34.434216 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:24:34.434216 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:24:34.434216 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:24:34.434216 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:24:34.434216 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:24:34.436587 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:24:34.436587 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:24:34.436587 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:24:34.436587 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:24:34.436587 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:24:34.436587 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:24:34.436587 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:24:34.436587 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cebf1f03-8c0a-4aaf-b375-63edcdac9d98 could not be found. May 25 16:24:34.436587 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:24:34.436587 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:24:34.436587 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:24:34.436587 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:24:34.436587 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:24:34.436587 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:24:34.436587 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:24:34.436587 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:24:34.436587 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cebf1f03-8c0a-4aaf-b375-63edcdac9d98 could not be found. May 25 16:24:34.436587 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:24:34.438730 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-e29a0863-b05c-4445-b9ef-f957f8f7c152 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Returning 404 to user: Instance cebf1f03-8c0a-4aaf-b375-63edcdac9d98 could not be found. {{(pid=117510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:24:34.438730 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-e29a0863-b05c-4445-b9ef-f957f8f7c152 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98" status: 404 len: 111 microversion: 2.1 time: 0.029522 May 25 16:24:34.438730 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 232/470] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:34 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:24:34.442572 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-58e914cd-ad2f-43c6-8a1d-eb5c3d062c90 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '.version_select at 0x7f51ee1655e0>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:34.465498 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-58e914cd-ad2f-43c6-8a1d-eb5c3d062c90 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1112922698" status: 202 len: 0 microversion: 2.1 time: 0.026599 May 25 16:24:34.466299 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 239/471] 10.222.0.42 () {58 vars in 1220 bytes} [Wed May 25 16:24:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1112922698 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:24:34.824979 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-e4d642f9-ece5-4160-aa85-ae29465d8799 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:34.826785 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-e4d642f9-ece5-4160-aa85-ae29465d8799 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:34.836622 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e4d642f9-ece5-4160-aa85-ae29465d8799 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:34.837086 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e4d642f9-ece5-4160-aa85-ae29465d8799 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:34.837908 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e4d642f9-ece5-4160-aa85-ae29465d8799 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:34.838352 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e4d642f9-ece5-4160-aa85-ae29465d8799 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:35.077357 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-e4d642f9-ece5-4160-aa85-ae29465d8799 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:35.086138 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-e4d642f9-ece5-4160-aa85-ae29465d8799 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1677 microversion: 2.1 time: 0.265337 May 25 16:24:35.086708 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 233/472] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:34 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1677 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:35.160866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-b7e73ab4-5ded-451f-b816-a56d773f4298 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:35.161522 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-b7e73ab4-5ded-451f-b816-a56d773f4298 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:35.167663 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b7e73ab4-5ded-451f-b816-a56d773f4298 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:35.168112 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b7e73ab4-5ded-451f-b816-a56d773f4298 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:35.168877 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b7e73ab4-5ded-451f-b816-a56d773f4298 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:35.169312 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b7e73ab4-5ded-451f-b816-a56d773f4298 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:35.213982 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-e567c238-2a7d-4358-a475-26b69d1b047e tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Action: 'create', calling method: .version_select at 0x7f51ef526af0>, body: {"keypair": {"name": "tempest-keypair-850530092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHc9A9v+vu3tcCj8Pvf1hp8VSC+o4tm1+m2gXyPuLiotn4kFlCMenpBcQ3dRfyXqoOSWF5piv6J1LYr3Sd0B3nRk0TAinsamLLuGPnGL2ulg2ChVKh5jsiNaHdwHDygynQ=="}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:24:35.229435 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-e567c238-2a7d-4358-a475-26b69d1b047e tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Getting quotas for project 9d234edace28441282f594f0e03cacc5. Resources: {'key_pairs'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:24:35.234600 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-e567c238-2a7d-4358-a475-26b69d1b047e tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Getting quotas for user b781c4c6cb61439fb781988a7da028ff and project 9d234edace28441282f594f0e03cacc5. Resources: {'key_pairs'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:24:35.257937 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-e567c238-2a7d-4358-a475-26b69d1b047e tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048452 May 25 16:24:35.258835 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 234/473] 10.222.0.42 () {60 vars in 1158 bytes} [Wed May 25 16:24:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:24:35.335280 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-b7e73ab4-5ded-451f-b816-a56d773f4298 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:35.344186 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-b7e73ab4-5ded-451f-b816-a56d773f4298 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1733 microversion: 2.1 time: 0.187228 May 25 16:24:35.344748 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 240/474] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:35 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1733 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:24:36.104670 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-ec59a596-5d8b-49e3-bad3-5237fb4ed38a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:36.105433 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-ec59a596-5d8b-49e3-bad3-5237fb4ed38a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:36.112151 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ec59a596-5d8b-49e3-bad3-5237fb4ed38a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:36.112607 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ec59a596-5d8b-49e3-bad3-5237fb4ed38a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:36.113381 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ec59a596-5d8b-49e3-bad3-5237fb4ed38a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:36.113865 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ec59a596-5d8b-49e3-bad3-5237fb4ed38a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:36.245389 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-ec59a596-5d8b-49e3-bad3-5237fb4ed38a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:36.253247 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-ec59a596-5d8b-49e3-bad3-5237fb4ed38a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1677 microversion: 2.1 time: 0.152703 May 25 16:24:36.254127 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 235/475] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:36 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:36.361420 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-bbaf6bab-3557-4de0-80f2-0445c98933b1 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:36.362161 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-bbaf6bab-3557-4de0-80f2-0445c98933b1 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:36.368371 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-bbaf6bab-3557-4de0-80f2-0445c98933b1 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:36.368854 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-bbaf6bab-3557-4de0-80f2-0445c98933b1 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:36.369628 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-bbaf6bab-3557-4de0-80f2-0445c98933b1 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:36.370499 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-bbaf6bab-3557-4de0-80f2-0445c98933b1 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:36.503814 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-bbaf6bab-3557-4de0-80f2-0445c98933b1 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:36.512230 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-bbaf6bab-3557-4de0-80f2-0445c98933b1 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1733 microversion: 2.1 time: 0.154933 May 25 16:24:36.513023 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 241/476] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:36 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:36.566712 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-e195af84-e7a2-491a-8126-02eec05f0902 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1337429380", "imageRef": "e74cccc1-cd1b-4dfc-8e47-3e4a832649a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "924a9156-87e8-4a10-ac35-4ba66726a4f5"}], "security_groups": [{"name": "tempest-securitygroup--1633382040"}], "key_name": "tempest-keypair-850530092", "user_data": "}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:24:36.674888 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.network.neutron [None req-e195af84-e7a2-491a-8126-02eec05f0902 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] validate_networks() for [('924a9156-87e8-4a10-ac35-4ba66726a4f5', None, None, None, None, None)] {{(pid=117510) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:24:37.034503 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-e195af84-e7a2-491a-8126-02eec05f0902 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Flavor limits 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:24:37.034932 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-e195af84-e7a2-491a-8126-02eec05f0902 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Image limits 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:24:37.035402 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-e195af84-e7a2-491a-8126-02eec05f0902 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Flavor pref 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:24:37.035811 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-e195af84-e7a2-491a-8126-02eec05f0902 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Image pref 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:24:37.036218 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-e195af84-e7a2-491a-8126-02eec05f0902 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:24:37.047283 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e195af84-e7a2-491a-8126-02eec05f0902 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:37.047726 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e195af84-e7a2-491a-8126-02eec05f0902 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:37.048521 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e195af84-e7a2-491a-8126-02eec05f0902 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:37.048956 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e195af84-e7a2-491a-8126-02eec05f0902 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:37.064991 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-e195af84-e7a2-491a-8126-02eec05f0902 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Getting quotas for project 9d234edace28441282f594f0e03cacc5. Resources: {'ram', 'cores', 'instances'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:24:37.068829 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-e195af84-e7a2-491a-8126-02eec05f0902 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Getting quotas for user b781c4c6cb61439fb781988a7da028ff and project 9d234edace28441282f594f0e03cacc5. Resources: {'ram', 'cores', 'instances'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:24:37.079998 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-e195af84-e7a2-491a-8126-02eec05f0902 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Going to run 1 instances... {{(pid=117510) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:24:37.082225 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-e195af84-e7a2-491a-8126-02eec05f0902 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e74cccc1-cd1b-4dfc-8e47-3e4a832649a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:24:37.127846 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-e195af84-e7a2-491a-8126-02eec05f0902 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.565421 May 25 16:24:37.128802 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 236/477] 10.222.0.42 () {60 vars in 1146 bytes} [Wed May 25 16:24:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:24:37.139810 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-58290225-fa5d-469c-845f-bf6aa315b7bf tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:37.140418 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-58290225-fa5d-469c-845f-bf6aa315b7bf tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:37.191838 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-58290225-fa5d-469c-845f-bf6aa315b7bf tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:37.198406 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-58290225-fa5d-469c-845f-bf6aa315b7bf tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af" status: 200 len: 1241 microversion: 2.1 time: 0.063262 May 25 16:24:37.198961 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 242/478] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:37 2022] GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:37.270304 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-29adfe75-06ef-4ec6-9a31-d492c294d44e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:37.270918 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-29adfe75-06ef-4ec6-9a31-d492c294d44e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:37.277105 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-29adfe75-06ef-4ec6-9a31-d492c294d44e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:37.277552 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-29adfe75-06ef-4ec6-9a31-d492c294d44e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:37.278357 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-29adfe75-06ef-4ec6-9a31-d492c294d44e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:37.278858 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-29adfe75-06ef-4ec6-9a31-d492c294d44e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:37.414018 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-29adfe75-06ef-4ec6-9a31-d492c294d44e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:37.421526 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-29adfe75-06ef-4ec6-9a31-d492c294d44e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1677 microversion: 2.1 time: 0.155045 May 25 16:24:37.422127 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 237/479] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:37 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:37.530482 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-5a71b249-fd8b-46f4-8b60-8bed339a0a2f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:37.531130 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-5a71b249-fd8b-46f4-8b60-8bed339a0a2f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:37.539033 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5a71b249-fd8b-46f4-8b60-8bed339a0a2f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:37.539828 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5a71b249-fd8b-46f4-8b60-8bed339a0a2f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:37.540609 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5a71b249-fd8b-46f4-8b60-8bed339a0a2f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:37.541248 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5a71b249-fd8b-46f4-8b60-8bed339a0a2f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:37.687731 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-5a71b249-fd8b-46f4-8b60-8bed339a0a2f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:37.695753 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-5a71b249-fd8b-46f4-8b60-8bed339a0a2f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1733 microversion: 2.1 time: 0.169779 May 25 16:24:37.696312 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 243/480] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:37 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1733 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:38.216851 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-4405f68b-5a96-4afe-bbec-45dc703345ec tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:38.217735 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-4405f68b-5a96-4afe-bbec-45dc703345ec tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:38.224721 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4405f68b-5a96-4afe-bbec-45dc703345ec tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:38.225446 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4405f68b-5a96-4afe-bbec-45dc703345ec tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:38.227449 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4405f68b-5a96-4afe-bbec-45dc703345ec tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:38.228438 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4405f68b-5a96-4afe-bbec-45dc703345ec tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:38.293269 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-4405f68b-5a96-4afe-bbec-45dc703345ec tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:38.301162 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-4405f68b-5a96-4afe-bbec-45dc703345ec tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af" status: 200 len: 1299 microversion: 2.1 time: 0.088904 May 25 16:24:38.301773 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 238/481] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:38 2022] GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:38.439452 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-b3b6d9ef-01fb-4b83-ae2f-15aaabb8ce5f tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:38.440219 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-b3b6d9ef-01fb-4b83-ae2f-15aaabb8ce5f tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:38.446362 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b3b6d9ef-01fb-4b83-ae2f-15aaabb8ce5f tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:38.446988 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b3b6d9ef-01fb-4b83-ae2f-15aaabb8ce5f tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:38.447866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b3b6d9ef-01fb-4b83-ae2f-15aaabb8ce5f tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:38.448300 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b3b6d9ef-01fb-4b83-ae2f-15aaabb8ce5f tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:38.576919 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-b3b6d9ef-01fb-4b83-ae2f-15aaabb8ce5f tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:38.584372 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-b3b6d9ef-01fb-4b83-ae2f-15aaabb8ce5f tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1677 microversion: 2.1 time: 0.149587 May 25 16:24:38.585022 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 244/482] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:38 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:38.713778 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-e8c52370-9224-4903-b0f6-98b0061974e2 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:38.714508 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-e8c52370-9224-4903-b0f6-98b0061974e2 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:38.720968 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e8c52370-9224-4903-b0f6-98b0061974e2 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:38.721513 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e8c52370-9224-4903-b0f6-98b0061974e2 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:38.725994 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e8c52370-9224-4903-b0f6-98b0061974e2 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:38.725994 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e8c52370-9224-4903-b0f6-98b0061974e2 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:38.863950 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-e8c52370-9224-4903-b0f6-98b0061974e2 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:38.873340 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-e8c52370-9224-4903-b0f6-98b0061974e2 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1733 microversion: 2.1 time: 0.163046 May 25 16:24:38.873948 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 239/483] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:38 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:39.319171 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-1e805d85-ef17-4a4a-abc7-309202352315 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:39.320099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-1e805d85-ef17-4a4a-abc7-309202352315 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:39.328175 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1e805d85-ef17-4a4a-abc7-309202352315 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:39.329481 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1e805d85-ef17-4a4a-abc7-309202352315 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:39.330524 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1e805d85-ef17-4a4a-abc7-309202352315 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:39.331035 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1e805d85-ef17-4a4a-abc7-309202352315 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:39.478163 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-1e805d85-ef17-4a4a-abc7-309202352315 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:39.487272 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-1e805d85-ef17-4a4a-abc7-309202352315 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af" status: 200 len: 1367 microversion: 2.1 time: 0.172039 May 25 16:24:39.499269 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 245/484] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:39 2022] GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:39.500575 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-299f4a79-fcb2-40fa-a93c-8193a5bc04b2 req-5a494aa5-856f-4a62-9993-7d5ebe10d8e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "125fb239-87ee-4665-94f5-252ee52d73af", "tag": "e7088f01-c534-435d-adca-470dfe4db83d"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:24:39.511283 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-299f4a79-fcb2-40fa-a93c-8193a5bc04b2 req-5a494aa5-856f-4a62-9993-7d5ebe10d8e9 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:39.511661 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-299f4a79-fcb2-40fa-a93c-8193a5bc04b2 req-5a494aa5-856f-4a62-9993-7d5ebe10d8e9 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:39.533980 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-299f4a79-fcb2-40fa-a93c-8193a5bc04b2 req-5a494aa5-856f-4a62-9993-7d5ebe10d8e9 service nova] Creating event network-changed:e7088f01-c534-435d-adca-470dfe4db83d for instance 125fb239-87ee-4665-94f5-252ee52d73af on hv-cinder-84327 May 25 16:24:39.539339 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-299f4a79-fcb2-40fa-a93c-8193a5bc04b2 req-5a494aa5-856f-4a62-9993-7d5ebe10d8e9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057146 May 25 16:24:39.539958 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 240/485] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:24:39.601439 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-5d459473-27d9-4fb4-8e8b-9cde2147bb0d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:39.602132 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-5d459473-27d9-4fb4-8e8b-9cde2147bb0d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:39.608892 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5d459473-27d9-4fb4-8e8b-9cde2147bb0d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:39.609344 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5d459473-27d9-4fb4-8e8b-9cde2147bb0d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:39.610153 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5d459473-27d9-4fb4-8e8b-9cde2147bb0d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:39.610586 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5d459473-27d9-4fb4-8e8b-9cde2147bb0d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:39.748504 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-5d459473-27d9-4fb4-8e8b-9cde2147bb0d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:39.756347 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-5d459473-27d9-4fb4-8e8b-9cde2147bb0d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1677 microversion: 2.1 time: 0.158836 May 25 16:24:39.757012 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 246/486] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:39 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:39.891758 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-6a9f72bb-f71a-4b56-be24-b94ca8d98ff0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:39.892611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-6a9f72bb-f71a-4b56-be24-b94ca8d98ff0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:39.898853 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6a9f72bb-f71a-4b56-be24-b94ca8d98ff0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:39.899412 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6a9f72bb-f71a-4b56-be24-b94ca8d98ff0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:39.900258 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6a9f72bb-f71a-4b56-be24-b94ca8d98ff0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:39.900774 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6a9f72bb-f71a-4b56-be24-b94ca8d98ff0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:40.027430 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-6a9f72bb-f71a-4b56-be24-b94ca8d98ff0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:40.035322 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-6a9f72bb-f71a-4b56-be24-b94ca8d98ff0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1733 microversion: 2.1 time: 0.148557 May 25 16:24:40.035886 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 241/487] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:39 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:40.506429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-ecb72f9a-8b0f-41e4-9954-03567e29652c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:40.507037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-ecb72f9a-8b0f-41e4-9954-03567e29652c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:40.513011 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ecb72f9a-8b0f-41e4-9954-03567e29652c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:40.513645 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ecb72f9a-8b0f-41e4-9954-03567e29652c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:40.514462 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ecb72f9a-8b0f-41e4-9954-03567e29652c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:40.514899 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ecb72f9a-8b0f-41e4-9954-03567e29652c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:40.639196 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-ecb72f9a-8b0f-41e4-9954-03567e29652c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:40.646536 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-ecb72f9a-8b0f-41e4-9954-03567e29652c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af" status: 200 len: 1367 microversion: 2.1 time: 0.143915 May 25 16:24:40.647099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 247/488] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:40 2022] GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af => generated 1367 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:40.774957 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-805d62c3-74b5-4c45-a488-74da9bb1dc70 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:40.775571 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-805d62c3-74b5-4c45-a488-74da9bb1dc70 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:40.783506 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-805d62c3-74b5-4c45-a488-74da9bb1dc70 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:40.783960 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-805d62c3-74b5-4c45-a488-74da9bb1dc70 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:40.784724 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-805d62c3-74b5-4c45-a488-74da9bb1dc70 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:40.785165 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-805d62c3-74b5-4c45-a488-74da9bb1dc70 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:41.052852 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-b1657e2b-ed15-484c-a1da-691e37e66ba9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:41.053620 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-b1657e2b-ed15-484c-a1da-691e37e66ba9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:41.063419 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b1657e2b-ed15-484c-a1da-691e37e66ba9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:41.063957 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b1657e2b-ed15-484c-a1da-691e37e66ba9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:41.064804 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b1657e2b-ed15-484c-a1da-691e37e66ba9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:41.065330 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b1657e2b-ed15-484c-a1da-691e37e66ba9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:41.176962 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-805d62c3-74b5-4c45-a488-74da9bb1dc70 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:41.188348 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-805d62c3-74b5-4c45-a488-74da9bb1dc70 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1677 microversion: 2.1 time: 0.417251 May 25 16:24:41.189228 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 242/489] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:40 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1677 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:41.222375 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-b1657e2b-ed15-484c-a1da-691e37e66ba9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:41.231051 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-b1657e2b-ed15-484c-a1da-691e37e66ba9 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1733 microversion: 2.1 time: 0.182060 May 25 16:24:41.231622 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 248/490] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:41 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1733 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:24:41.664532 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-4769b167-9c3d-42fc-9438-6b49bbca512a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:41.665083 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-4769b167-9c3d-42fc-9438-6b49bbca512a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:41.671824 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4769b167-9c3d-42fc-9438-6b49bbca512a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:41.672267 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4769b167-9c3d-42fc-9438-6b49bbca512a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:41.673023 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4769b167-9c3d-42fc-9438-6b49bbca512a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:41.673456 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4769b167-9c3d-42fc-9438-6b49bbca512a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:41.804184 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-4769b167-9c3d-42fc-9438-6b49bbca512a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:41.812169 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-4769b167-9c3d-42fc-9438-6b49bbca512a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af" status: 200 len: 1367 microversion: 2.1 time: 0.151897 May 25 16:24:41.812726 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 243/491] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:41 2022] GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:42.205556 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-de8accad-8a77-486d-9d3d-6db8feb7eef5 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:42.206212 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-de8accad-8a77-486d-9d3d-6db8feb7eef5 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:42.212184 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-de8accad-8a77-486d-9d3d-6db8feb7eef5 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:42.212619 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-de8accad-8a77-486d-9d3d-6db8feb7eef5 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:42.213357 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-de8accad-8a77-486d-9d3d-6db8feb7eef5 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:42.213826 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-de8accad-8a77-486d-9d3d-6db8feb7eef5 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:42.248019 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-f3a17137-9f53-495e-88d4-1bbb404601c7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:42.248848 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-f3a17137-9f53-495e-88d4-1bbb404601c7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:42.255992 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f3a17137-9f53-495e-88d4-1bbb404601c7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:42.256526 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f3a17137-9f53-495e-88d4-1bbb404601c7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:42.257375 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f3a17137-9f53-495e-88d4-1bbb404601c7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:42.257860 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f3a17137-9f53-495e-88d4-1bbb404601c7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:42.393447 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-de8accad-8a77-486d-9d3d-6db8feb7eef5 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:42.401510 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-de8accad-8a77-486d-9d3d-6db8feb7eef5 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1677 microversion: 2.1 time: 0.200596 May 25 16:24:42.402335 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 249/492] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:42 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1677 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:42.419498 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-f3a17137-9f53-495e-88d4-1bbb404601c7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:42.427345 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-f3a17137-9f53-495e-88d4-1bbb404601c7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1733 microversion: 2.1 time: 0.183192 May 25 16:24:42.427940 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 244/493] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:42 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1733 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:24:42.829861 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-3c99f67f-e59d-4a21-bcbc-2250e7f7ddae tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:42.830462 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-3c99f67f-e59d-4a21-bcbc-2250e7f7ddae tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:42.836252 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3c99f67f-e59d-4a21-bcbc-2250e7f7ddae tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:42.836673 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3c99f67f-e59d-4a21-bcbc-2250e7f7ddae tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:42.837489 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3c99f67f-e59d-4a21-bcbc-2250e7f7ddae tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:42.838012 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3c99f67f-e59d-4a21-bcbc-2250e7f7ddae tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:42.971747 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-3c99f67f-e59d-4a21-bcbc-2250e7f7ddae tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:42.979042 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-3c99f67f-e59d-4a21-bcbc-2250e7f7ddae tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af" status: 200 len: 1367 microversion: 2.1 time: 0.153736 May 25 16:24:42.979601 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 250/494] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:42 2022] GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:43.420437 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-16d45db1-ce76-458e-861c-ae0fd0049313 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:43.421184 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-16d45db1-ce76-458e-861c-ae0fd0049313 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:43.427630 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-16d45db1-ce76-458e-861c-ae0fd0049313 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:43.428072 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-16d45db1-ce76-458e-861c-ae0fd0049313 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:43.428830 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-16d45db1-ce76-458e-861c-ae0fd0049313 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:43.429255 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-16d45db1-ce76-458e-861c-ae0fd0049313 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:43.444181 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-0cdcccf4-4036-4607-83c7-80a9ecbff165 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:43.444874 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-0cdcccf4-4036-4607-83c7-80a9ecbff165 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:43.451436 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0cdcccf4-4036-4607-83c7-80a9ecbff165 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:43.451928 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0cdcccf4-4036-4607-83c7-80a9ecbff165 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:43.452693 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0cdcccf4-4036-4607-83c7-80a9ecbff165 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:43.453170 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0cdcccf4-4036-4607-83c7-80a9ecbff165 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:43.634372 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-16d45db1-ce76-458e-861c-ae0fd0049313 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:43.638717 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-0cdcccf4-4036-4607-83c7-80a9ecbff165 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:43.642203 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-16d45db1-ce76-458e-861c-ae0fd0049313 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1677 microversion: 2.1 time: 0.226355 May 25 16:24:43.642786 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 245/495] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:43 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1677 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:43.647886 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-0cdcccf4-4036-4607-83c7-80a9ecbff165 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1733 microversion: 2.1 time: 0.207438 May 25 16:24:43.654236 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 251/496] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:43 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1733 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:24:43.996358 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-4860226e-24a4-4a35-8ed0-6ad9709c7bef tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:43.996958 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-4860226e-24a4-4a35-8ed0-6ad9709c7bef tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:44.002993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4860226e-24a4-4a35-8ed0-6ad9709c7bef tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:44.003440 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4860226e-24a4-4a35-8ed0-6ad9709c7bef tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:44.004222 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4860226e-24a4-4a35-8ed0-6ad9709c7bef tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:44.004656 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4860226e-24a4-4a35-8ed0-6ad9709c7bef tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:44.136402 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-4860226e-24a4-4a35-8ed0-6ad9709c7bef tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:44.145543 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-4860226e-24a4-4a35-8ed0-6ad9709c7bef tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af" status: 200 len: 1367 microversion: 2.1 time: 0.152934 May 25 16:24:44.146251 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 246/497] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:43 2022] GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:44.659433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-6b809a41-b21f-4e42-b62a-d7b0c0f232f4 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:44.659969 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-6b809a41-b21f-4e42-b62a-d7b0c0f232f4 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:44.666454 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6b809a41-b21f-4e42-b62a-d7b0c0f232f4 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:44.666900 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6b809a41-b21f-4e42-b62a-d7b0c0f232f4 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:44.667655 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6b809a41-b21f-4e42-b62a-d7b0c0f232f4 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:44.668088 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6b809a41-b21f-4e42-b62a-d7b0c0f232f4 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:44.668207 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-785660a8-be17-4b1e-aa40-20edc54a743b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:44.668749 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-785660a8-be17-4b1e-aa40-20edc54a743b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:44.676018 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-785660a8-be17-4b1e-aa40-20edc54a743b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:44.676461 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-785660a8-be17-4b1e-aa40-20edc54a743b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:44.677213 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-785660a8-be17-4b1e-aa40-20edc54a743b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:44.677641 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-785660a8-be17-4b1e-aa40-20edc54a743b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:44.861191 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-785660a8-be17-4b1e-aa40-20edc54a743b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:44.863983 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-6b809a41-b21f-4e42-b62a-d7b0c0f232f4 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:44.869234 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-785660a8-be17-4b1e-aa40-20edc54a743b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1733 microversion: 2.1 time: 0.204806 May 25 16:24:44.869814 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 247/498] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:44 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1733 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:24:44.871708 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-6b809a41-b21f-4e42-b62a-d7b0c0f232f4 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1677 microversion: 2.1 time: 0.216236 May 25 16:24:44.872263 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 252/499] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:44 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1677 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:45.163927 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-9007d7ed-f965-45f0-95e1-07bef2950b1a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:45.164552 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-9007d7ed-f965-45f0-95e1-07bef2950b1a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:45.171385 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9007d7ed-f965-45f0-95e1-07bef2950b1a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:45.171825 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9007d7ed-f965-45f0-95e1-07bef2950b1a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:45.172579 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9007d7ed-f965-45f0-95e1-07bef2950b1a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:45.173008 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9007d7ed-f965-45f0-95e1-07bef2950b1a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:45.299831 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-9007d7ed-f965-45f0-95e1-07bef2950b1a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:45.307162 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-9007d7ed-f965-45f0-95e1-07bef2950b1a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af" status: 200 len: 1367 microversion: 2.1 time: 0.147326 May 25 16:24:45.307728 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 248/500] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:45 2022] GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:45.667929 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-e795896a-d896-4778-aeb5-ad71e178c119 req-38c3809c-3e46-4d29-80bd-1ef1f324b2ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "125fb239-87ee-4665-94f5-252ee52d73af", "name": "network-vif-plugged", "status": "completed", "tag": "e7088f01-c534-435d-adca-470dfe4db83d"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:24:45.676401 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-e795896a-d896-4778-aeb5-ad71e178c119 req-38c3809c-3e46-4d29-80bd-1ef1f324b2ef service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:45.676882 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-e795896a-d896-4778-aeb5-ad71e178c119 req-38c3809c-3e46-4d29-80bd-1ef1f324b2ef service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:45.689985 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-e795896a-d896-4778-aeb5-ad71e178c119 req-38c3809c-3e46-4d29-80bd-1ef1f324b2ef service nova] Creating event network-vif-plugged:e7088f01-c534-435d-adca-470dfe4db83d for instance 125fb239-87ee-4665-94f5-252ee52d73af on hv-cinder-84327 May 25 16:24:45.694765 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-e795896a-d896-4778-aeb5-ad71e178c119 req-38c3809c-3e46-4d29-80bd-1ef1f324b2ef service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030862 May 25 16:24:45.695558 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 253/501] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:24:45.887247 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-679682b0-e304-48b3-8e66-9841b670e1ba tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:45.888414 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-679682b0-e304-48b3-8e66-9841b670e1ba tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:45.889261 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-571a3c5d-96ab-40d3-8f03-be9c2b4c71cc tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:45.890221 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-571a3c5d-96ab-40d3-8f03-be9c2b4c71cc tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:45.894641 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-679682b0-e304-48b3-8e66-9841b670e1ba tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:45.895157 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-679682b0-e304-48b3-8e66-9841b670e1ba tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:45.895867 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-679682b0-e304-48b3-8e66-9841b670e1ba tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:45.896305 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-679682b0-e304-48b3-8e66-9841b670e1ba tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:45.896950 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-571a3c5d-96ab-40d3-8f03-be9c2b4c71cc tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:45.897462 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-571a3c5d-96ab-40d3-8f03-be9c2b4c71cc tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:45.898334 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-571a3c5d-96ab-40d3-8f03-be9c2b4c71cc tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:45.898837 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-571a3c5d-96ab-40d3-8f03-be9c2b4c71cc tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:46.086523 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-679682b0-e304-48b3-8e66-9841b670e1ba tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:46.095164 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-679682b0-e304-48b3-8e66-9841b670e1ba tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1733 microversion: 2.1 time: 0.212563 May 25 16:24:46.095742 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 249/502] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:45 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1733 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:46.098038 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-571a3c5d-96ab-40d3-8f03-be9c2b4c71cc tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:46.105524 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-571a3c5d-96ab-40d3-8f03-be9c2b4c71cc tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1677 microversion: 2.1 time: 0.221084 May 25 16:24:46.106187 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 254/503] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:45 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1677 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:46.324691 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-40b3c988-8752-4a05-90a9-71d3393d4cba tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:46.325297 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-40b3c988-8752-4a05-90a9-71d3393d4cba tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:46.332149 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-40b3c988-8752-4a05-90a9-71d3393d4cba tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:46.332598 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-40b3c988-8752-4a05-90a9-71d3393d4cba tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:46.333350 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-40b3c988-8752-4a05-90a9-71d3393d4cba tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:46.333810 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-40b3c988-8752-4a05-90a9-71d3393d4cba tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:46.351535 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=100 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:24:46.462288 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-40b3c988-8752-4a05-90a9-71d3393d4cba tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:46.469822 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-40b3c988-8752-4a05-90a9-71d3393d4cba tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af" status: 200 len: 1367 microversion: 2.1 time: 0.149296 May 25 16:24:46.470378 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 250/504] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:46 2022] GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:47.112804 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-c5aae8d7-6d65-4220-89db-7e987b6afc0a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:47.113407 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-c5aae8d7-6d65-4220-89db-7e987b6afc0a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:47.119482 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c5aae8d7-6d65-4220-89db-7e987b6afc0a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:47.119929 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c5aae8d7-6d65-4220-89db-7e987b6afc0a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:47.120688 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c5aae8d7-6d65-4220-89db-7e987b6afc0a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:47.121121 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c5aae8d7-6d65-4220-89db-7e987b6afc0a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:47.122372 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-6461beca-0124-456b-be63-3bc257f16d91 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:47.123056 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-6461beca-0124-456b-be63-3bc257f16d91 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:47.125295 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell0:SELECT=2 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:24:47.126129 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell0:SELECT=10 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:24:47.128073 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:24:47.133739 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6461beca-0124-456b-be63-3bc257f16d91 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:47.134205 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6461beca-0124-456b-be63-3bc257f16d91 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:47.134973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6461beca-0124-456b-be63-3bc257f16d91 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:47.135542 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6461beca-0124-456b-be63-3bc257f16d91 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:47.140855 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=100 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:24:47.196108 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell0:SELECT=2 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:24:47.324767 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-c5aae8d7-6d65-4220-89db-7e987b6afc0a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:47.332190 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-6461beca-0124-456b-be63-3bc257f16d91 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:47.333519 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-c5aae8d7-6d65-4220-89db-7e987b6afc0a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1733 microversion: 2.1 time: 0.224483 May 25 16:24:47.334479 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 255/505] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:47 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1733 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:47.346679 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-6461beca-0124-456b-be63-3bc257f16d91 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1677 microversion: 2.1 time: 0.228130 May 25 16:24:47.347270 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 251/506] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:47 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1677 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:47.486859 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-5384d520-2cdd-414c-b680-da7ca8be59d8 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:47.487456 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-5384d520-2cdd-414c-b680-da7ca8be59d8 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:47.493385 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5384d520-2cdd-414c-b680-da7ca8be59d8 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:47.493862 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5384d520-2cdd-414c-b680-da7ca8be59d8 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:47.494604 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5384d520-2cdd-414c-b680-da7ca8be59d8 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:47.495029 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5384d520-2cdd-414c-b680-da7ca8be59d8 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:47.626969 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-5384d520-2cdd-414c-b680-da7ca8be59d8 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:47.634478 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-5384d520-2cdd-414c-b680-da7ca8be59d8 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af" status: 200 len: 1367 microversion: 2.1 time: 0.151383 May 25 16:24:47.635047 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 256/507] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:47 2022] GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:48.351736 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-529449f9-517f-4047-ab04-2722b9954634 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:48.352345 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-529449f9-517f-4047-ab04-2722b9954634 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:48.360452 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-529449f9-517f-4047-ab04-2722b9954634 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:48.360935 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-529449f9-517f-4047-ab04-2722b9954634 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:48.361811 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-529449f9-517f-4047-ab04-2722b9954634 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:48.362315 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-529449f9-517f-4047-ab04-2722b9954634 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:48.365696 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-1ef8bb76-0d29-47e0-9343-e7ab254cd18b tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:48.366462 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-1ef8bb76-0d29-47e0-9343-e7ab254cd18b tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:48.373495 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1ef8bb76-0d29-47e0-9343-e7ab254cd18b tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:48.374060 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1ef8bb76-0d29-47e0-9343-e7ab254cd18b tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:48.374904 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1ef8bb76-0d29-47e0-9343-e7ab254cd18b tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:48.375411 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1ef8bb76-0d29-47e0-9343-e7ab254cd18b tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:48.550301 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-529449f9-517f-4047-ab04-2722b9954634 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:48.558392 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-529449f9-517f-4047-ab04-2722b9954634 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1733 microversion: 2.1 time: 0.211026 May 25 16:24:48.559018 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 252/508] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:48 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1733 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:48.564457 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-1ef8bb76-0d29-47e0-9343-e7ab254cd18b tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:48.571988 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-1ef8bb76-0d29-47e0-9343-e7ab254cd18b tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1654 microversion: 2.1 time: 0.211414 May 25 16:24:48.572541 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 257/509] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:48 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1654 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:48.589379 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-d16bd9f1-8666-4610-a991-6917cedee003 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:24:48.596061 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d16bd9f1-8666-4610-a991-6917cedee003 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:48.596509 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d16bd9f1-8666-4610-a991-6917cedee003 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:48.617804 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-d16bd9f1-8666-4610-a991-6917cedee003 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Going to try to start instance {{(pid=117510) start /opt/stack/nova/nova/compute/api.py:2730}} May 25 16:24:48.651151 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-36a63ce8-c7da-4301-978a-d8a961850291 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:48.651751 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-36a63ce8-c7da-4301-978a-d8a961850291 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:48.658398 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-d16bd9f1-8666-4610-a991-6917cedee003 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "POST /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f/action" status: 202 len: 0 microversion: 2.1 time: 0.072617 May 25 16:24:48.658612 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-36a63ce8-c7da-4301-978a-d8a961850291 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:48.658979 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-36a63ce8-c7da-4301-978a-d8a961850291 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:48.659120 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 253/510] 10.222.0.42 () {60 vars in 1277 bytes} [Wed May 25 16:24:48 2022] POST /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:24:48.659776 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-36a63ce8-c7da-4301-978a-d8a961850291 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:48.660157 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-36a63ce8-c7da-4301-978a-d8a961850291 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:48.667440 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-f173d74d-0f10-4e5d-aea4-dcd57571b6b4 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:48.668126 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-f173d74d-0f10-4e5d-aea4-dcd57571b6b4 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:48.674541 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f173d74d-0f10-4e5d-aea4-dcd57571b6b4 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:48.674993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f173d74d-0f10-4e5d-aea4-dcd57571b6b4 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:48.675759 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f173d74d-0f10-4e5d-aea4-dcd57571b6b4 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:48.676197 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f173d74d-0f10-4e5d-aea4-dcd57571b6b4 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:48.844575 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-36a63ce8-c7da-4301-978a-d8a961850291 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:48.852167 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-36a63ce8-c7da-4301-978a-d8a961850291 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af" status: 200 len: 1558 microversion: 2.1 time: 0.204774 May 25 16:24:48.852731 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 258/511] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:48 2022] GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af => generated 1558 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:24:48.867992 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-f173d74d-0f10-4e5d-aea4-dcd57571b6b4 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:48.868641 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-a5f0f5ea-4fe2-4368-8d1b-3a36eabdf74b tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:48.869131 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-a5f0f5ea-4fe2-4368-8d1b-3a36eabdf74b tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:48.876023 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a5f0f5ea-4fe2-4368-8d1b-3a36eabdf74b tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:48.876202 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-f173d74d-0f10-4e5d-aea4-dcd57571b6b4 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1663 microversion: 2.1 time: 0.212611 May 25 16:24:48.876459 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a5f0f5ea-4fe2-4368-8d1b-3a36eabdf74b tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:48.876770 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 254/512] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:48 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1663 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:48.877205 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a5f0f5ea-4fe2-4368-8d1b-3a36eabdf74b tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:48.877747 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a5f0f5ea-4fe2-4368-8d1b-3a36eabdf74b tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:48.958435 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-a5f0f5ea-4fe2-4368-8d1b-3a36eabdf74b tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093661 May 25 16:24:48.959030 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 259/513] 10.222.0.42 () {58 vars in 1274 bytes} [Wed May 25 16:24:48 2022] GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:24:49.576406 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-a18d59db-957e-4628-8e87-b0c992084d69 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:49.577012 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-a18d59db-957e-4628-8e87-b0c992084d69 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:49.583371 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a18d59db-957e-4628-8e87-b0c992084d69 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:49.584406 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a18d59db-957e-4628-8e87-b0c992084d69 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:49.585149 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a18d59db-957e-4628-8e87-b0c992084d69 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:49.585582 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a18d59db-957e-4628-8e87-b0c992084d69 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:49.811862 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-a18d59db-957e-4628-8e87-b0c992084d69 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:49.819757 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-a18d59db-957e-4628-8e87-b0c992084d69 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1733 microversion: 2.1 time: 0.247888 May 25 16:24:49.820326 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 255/514] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:49 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1733 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:49.892611 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-002ff5f8-381a-4330-a52e-346e4010f223 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:49.893236 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-002ff5f8-381a-4330-a52e-346e4010f223 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:49.899214 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-002ff5f8-381a-4330-a52e-346e4010f223 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:49.899658 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-002ff5f8-381a-4330-a52e-346e4010f223 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:49.900414 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-002ff5f8-381a-4330-a52e-346e4010f223 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:49.900877 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-002ff5f8-381a-4330-a52e-346e4010f223 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:50.001031 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-352faff3-13b8-40f8-99e9-26da7ca9e258 req-46b27d03-13cb-49ae-ad37-e2f1dbc1a6f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "125fb239-87ee-4665-94f5-252ee52d73af", "tag": "e7088f01-c534-435d-adca-470dfe4db83d"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:24:50.010395 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-352faff3-13b8-40f8-99e9-26da7ca9e258 req-46b27d03-13cb-49ae-ad37-e2f1dbc1a6f5 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:50.010966 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-352faff3-13b8-40f8-99e9-26da7ca9e258 req-46b27d03-13cb-49ae-ad37-e2f1dbc1a6f5 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:50.029699 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-352faff3-13b8-40f8-99e9-26da7ca9e258 req-46b27d03-13cb-49ae-ad37-e2f1dbc1a6f5 service nova] Creating event network-changed:e7088f01-c534-435d-adca-470dfe4db83d for instance 125fb239-87ee-4665-94f5-252ee52d73af on hv-cinder-84327 May 25 16:24:50.035822 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-352faff3-13b8-40f8-99e9-26da7ca9e258 req-46b27d03-13cb-49ae-ad37-e2f1dbc1a6f5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039735 May 25 16:24:50.037313 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 256/515] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:24:50.126156 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-002ff5f8-381a-4330-a52e-346e4010f223 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:50.136955 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-002ff5f8-381a-4330-a52e-346e4010f223 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1663 microversion: 2.1 time: 0.248256 May 25 16:24:50.137539 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 260/516] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:49 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1663 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:50.548446 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-ffafbb83-b47f-4b95-8cc3-20af5f3a82c7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:50.548954 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-ffafbb83-b47f-4b95-8cc3-20af5f3a82c7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:50.555225 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ffafbb83-b47f-4b95-8cc3-20af5f3a82c7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:50.555679 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ffafbb83-b47f-4b95-8cc3-20af5f3a82c7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:50.556454 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ffafbb83-b47f-4b95-8cc3-20af5f3a82c7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:50.556889 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ffafbb83-b47f-4b95-8cc3-20af5f3a82c7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:50.592569 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-ffafbb83-b47f-4b95-8cc3-20af5f3a82c7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef/os-volume_attachments/09569e49-293c-4b27-a9b3-34a037742940" status: 200 len: 194 microversion: 2.20 time: 0.048528 May 25 16:24:50.593265 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 257/517] 10.222.0.42 () {60 vars in 1453 bytes} [Wed May 25 16:24:50 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef/os-volume_attachments/09569e49-293c-4b27-a9b3-34a037742940 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:24:50.666149 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-58471102-f0ef-48c1-b1c3-2b10b034f5fe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:50.666641 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-58471102-f0ef-48c1-b1c3-2b10b034f5fe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:50.673091 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-58471102-f0ef-48c1-b1c3-2b10b034f5fe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:50.673524 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-58471102-f0ef-48c1-b1c3-2b10b034f5fe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:50.674306 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-58471102-f0ef-48c1-b1c3-2b10b034f5fe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:50.674730 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-58471102-f0ef-48c1-b1c3-2b10b034f5fe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:50.760770 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.objects.instance [None req-58471102-f0ef-48c1-b1c3-2b10b034f5fe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lazy-loading 'services' on Instance uuid d3da72ce-f083-455e-ae40-9530c53126ef {{(pid=117509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:24:50.836586 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-9d273739-3522-46cf-9314-bb7d86f66e8f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:50.837501 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-9d273739-3522-46cf-9314-bb7d86f66e8f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:50.843772 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-58471102-f0ef-48c1-b1c3-2b10b034f5fe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef/os-volume_attachments/09569e49-293c-4b27-a9b3-34a037742940" status: 202 len: 0 microversion: 2.20 time: 0.181611 May 25 16:24:50.844532 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 261/518] 10.222.0.42 () {60 vars in 1456 bytes} [Wed May 25 16:24:50 2022] DELETE /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef/os-volume_attachments/09569e49-293c-4b27-a9b3-34a037742940 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 16:24:50.850427 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9d273739-3522-46cf-9314-bb7d86f66e8f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:50.850982 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9d273739-3522-46cf-9314-bb7d86f66e8f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:50.851811 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9d273739-3522-46cf-9314-bb7d86f66e8f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:50.852336 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9d273739-3522-46cf-9314-bb7d86f66e8f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:50.853462 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-942f1759-e1cc-4ce0-9b68-780ee8b5b62f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:50.854700 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-942f1759-e1cc-4ce0-9b68-780ee8b5b62f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:50.861578 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-942f1759-e1cc-4ce0-9b68-780ee8b5b62f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:50.862065 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-942f1759-e1cc-4ce0-9b68-780ee8b5b62f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:50.862835 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-942f1759-e1cc-4ce0-9b68-780ee8b5b62f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:50.863269 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-942f1759-e1cc-4ce0-9b68-780ee8b5b62f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:50.895457 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-942f1759-e1cc-4ce0-9b68-780ee8b5b62f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046218 May 25 16:24:50.896105 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 262/519] 10.222.0.42 () {60 vars in 1342 bytes} [Wed May 25 16:24:50 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:24:50.990506 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-9d273739-3522-46cf-9314-bb7d86f66e8f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:50.999446 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-9d273739-3522-46cf-9314-bb7d86f66e8f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1713 microversion: 2.1 time: 0.167062 May 25 16:24:51.000019 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 258/520] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:50 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1713 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:24:51.104235 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-c4b79994-312b-42e4-9b83-98dd2065fc63 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:51.104822 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-c4b79994-312b-42e4-9b83-98dd2065fc63 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:51.110942 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c4b79994-312b-42e4-9b83-98dd2065fc63 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:51.111469 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c4b79994-312b-42e4-9b83-98dd2065fc63 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:51.112297 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c4b79994-312b-42e4-9b83-98dd2065fc63 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:51.112806 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c4b79994-312b-42e4-9b83-98dd2065fc63 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:51.154704 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-d75f31ed-eb8d-40f9-8641-9dcd2a33ba71 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:51.155308 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-d75f31ed-eb8d-40f9-8641-9dcd2a33ba71 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:51.161423 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d75f31ed-eb8d-40f9-8641-9dcd2a33ba71 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:51.162151 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d75f31ed-eb8d-40f9-8641-9dcd2a33ba71 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:51.163339 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d75f31ed-eb8d-40f9-8641-9dcd2a33ba71 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:51.163947 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d75f31ed-eb8d-40f9-8641-9dcd2a33ba71 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:51.201232 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.wsgi [None req-c4b79994-312b-42e4-9b83-98dd2065fc63 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] HTTP exception thrown: Cannot 'detach_volume' instance f68f3730-3984-4aef-9c58-e87b09051c87 while it is in vm_state rescued May 25 16:24:51.202919 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-c4b79994-312b-42e4-9b83-98dd2065fc63 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Request method failure captured: May 25 16:24:51.202919 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: DELETE /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87/os-volume_attachments/1d650010-f487-44a8-84e4-92ec565504b5 HTTP/1.1 May 25 16:24:51.202919 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:24:51.202919 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:24:51.202919 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:24:51.202919 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 0 May 25 16:24:51.202919 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:24:51.202919 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:24:51.202919 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:24:51.202919 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:24:51.202919 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijldYEk-vXf1RzTAhtuBmZCP64e-jFGtt4_4AUU4JvgXjFozEXheYHuLBoLnaDKX2hw8HHhJRSLtnCpwINlrLr_XZWKytjwNPB5nW99kaEc4sI4nUx8x4Ptx9q5FVs8jmBgiEaPPAaP7XvfqFLdfWYv34Y_gMy5FtTHmgzN_RasZUKJo May 25 16:24:51.202919 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:24:51.202919 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:24:51.202919 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:24:51.202919 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:24:51.202919 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:24:51.202919 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:24:51.202919 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: 95d1e25b20a146c198dfeda0dc43cd72 May 25 16:24:51.202919 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1964636607 May 25 16:24:51.202919 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:24:51.202919 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:24:51.204429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/95d1e25b20a146c198dfeda0dc43cd72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/95d1e25b20a146c198dfeda0dc43cd72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_95d1e25b20a146c198dfeda0dc43cd72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/95d1e25b20a146c198dfeda0dc43cd72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:24:51.204429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1964636607 May 25 16:24:51.204429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: 95d1e25b20a146c198dfeda0dc43cd72 May 25 16:24:51.204429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1964636607 May 25 16:24:51.204429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-ServerRescueNegativeTestJSON-1964636607-project May 25 16:24:51.204429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:24:51.204429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:24:51.204429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: 30de794b71b343289491531dfbe37f53 May 25 16:24:51.204429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1964636607-project May 25 16:24:51.204429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: > May 25 16:24:51.204429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Cannot 'detach_volume' instance f68f3730-3984-4aef-9c58-e87b09051c87 while it is in vm_state rescued May 25 16:24:51.205113 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'server_id': 'f68f3730-3984-4aef-9c58-e87b09051c87', 'id': '1d650010-f487-44a8-84e4-92ec565504b5'} May 25 16:24:51.205113 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:24:51.205113 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:24:51.205113 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 25 16:24:51.205113 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 25 16:24:51.205113 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 25 16:24:51.205113 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 25 16:24:51.205113 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 25 16:24:51.205113 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 25 16:24:51.205113 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f68f3730-3984-4aef-9c58-e87b09051c87 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 25 16:24:51.205113 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:24:51.205113 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:24:51.205113 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:24:51.205113 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:24:51.205113 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:24:51.205113 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:24:51.205113 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:24:51.205113 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:24:51.205113 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:24:51.205113 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:24:51.206491 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 25 16:24:51.206491 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 25 16:24:51.206491 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 25 16:24:51.206491 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 25 16:24:51.206491 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f68f3730-3984-4aef-9c58-e87b09051c87 while it is in vm_state rescued May 25 16:24:51.206491 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:24:51.206491 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:24:51.206491 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:24:51.206491 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:24:51.206491 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:24:51.206491 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:24:51.206491 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:24:51.206491 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:24:51.206491 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f68f3730-3984-4aef-9c58-e87b09051c87 while it is in vm_state rescued May 25 16:24:51.206491 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:24:51.206491 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-c4b79994-312b-42e4-9b83-98dd2065fc63 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Returning 409 to user: Cannot 'detach_volume' instance f68f3730-3984-4aef-9c58-e87b09051c87 while it is in vm_state rescued {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:24:51.207656 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-c4b79994-312b-42e4-9b83-98dd2065fc63 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87/os-volume_attachments/1d650010-f487-44a8-84e4-92ec565504b5" status: 409 len: 152 microversion: 2.1 time: 0.104136 May 25 16:24:51.207656 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 263/521] 10.222.0.42 () {58 vars in 1415 bytes} [Wed May 25 16:24:51 2022] DELETE /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87/os-volume_attachments/1d650010-f487-44a8-84e4-92ec565504b5 => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 25 16:24:51.212922 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-212e0a98-b507-4d85-9bb3-4599494b6561 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:24:51.213447 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-212e0a98-b507-4d85-9bb3-4599494b6561 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:51.216757 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:24:51.220763 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-212e0a98-b507-4d85-9bb3-4599494b6561 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:51.221210 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-212e0a98-b507-4d85-9bb3-4599494b6561 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:51.222206 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-212e0a98-b507-4d85-9bb3-4599494b6561 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:51.222637 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-212e0a98-b507-4d85-9bb3-4599494b6561 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:51.298670 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-212e0a98-b507-4d85-9bb3-4599494b6561 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "POST /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87/action" status: 202 len: 0 microversion: 2.1 time: 0.089234 May 25 16:24:51.299424 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 264/522] 10.222.0.42 () {60 vars in 1277 bytes} [Wed May 25 16:24:51 2022] POST /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 16:24:51.307928 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-c7fbb2a2-bd85-424f-962d-54d72afefafa tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:51.308604 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-c7fbb2a2-bd85-424f-962d-54d72afefafa tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:51.308715 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-d75f31ed-eb8d-40f9-8641-9dcd2a33ba71 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:51.315486 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c7fbb2a2-bd85-424f-962d-54d72afefafa tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:51.316158 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c7fbb2a2-bd85-424f-962d-54d72afefafa tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:51.317110 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c7fbb2a2-bd85-424f-962d-54d72afefafa tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:51.317697 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c7fbb2a2-bd85-424f-962d-54d72afefafa tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:51.319599 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-d75f31ed-eb8d-40f9-8641-9dcd2a33ba71 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1663 microversion: 2.1 time: 0.168531 May 25 16:24:51.320933 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 259/523] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:51 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1663 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:24:51.535150 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-c7fbb2a2-bd85-424f-962d-54d72afefafa tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:51.544876 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-c7fbb2a2-bd85-424f-962d-54d72afefafa tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1721 microversion: 2.1 time: 0.241028 May 25 16:24:51.545530 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 265/524] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:51 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:24:51.908145 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-4fd5efe0-d0de-4867-881c-b5805ab0f13f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:51.909113 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-4fd5efe0-d0de-4867-881c-b5805ab0f13f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:51.916046 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4fd5efe0-d0de-4867-881c-b5805ab0f13f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:51.916496 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4fd5efe0-d0de-4867-881c-b5805ab0f13f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:51.917259 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4fd5efe0-d0de-4867-881c-b5805ab0f13f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:51.917696 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4fd5efe0-d0de-4867-881c-b5805ab0f13f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:51.954286 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-4fd5efe0-d0de-4867-881c-b5805ab0f13f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050827 May 25 16:24:51.954861 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 260/525] 10.222.0.42 () {60 vars in 1342 bytes} [Wed May 25 16:24:51 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:24:52.338174 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-35276cf5-45cb-4119-b04f-30f3536bb8c7 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:52.338753 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-35276cf5-45cb-4119-b04f-30f3536bb8c7 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:52.344975 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-35276cf5-45cb-4119-b04f-30f3536bb8c7 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:52.345415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-35276cf5-45cb-4119-b04f-30f3536bb8c7 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:52.346189 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-35276cf5-45cb-4119-b04f-30f3536bb8c7 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:52.346612 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-35276cf5-45cb-4119-b04f-30f3536bb8c7 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:52.472775 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-35276cf5-45cb-4119-b04f-30f3536bb8c7 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:52.480172 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-35276cf5-45cb-4119-b04f-30f3536bb8c7 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1667 microversion: 2.1 time: 0.145837 May 25 16:24:52.480751 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 266/526] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:52 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1667 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:52.562897 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-c9827f23-0277-4dd5-aa67-d7144e9927ea tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:52.563496 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-c9827f23-0277-4dd5-aa67-d7144e9927ea tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:52.569478 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c9827f23-0277-4dd5-aa67-d7144e9927ea tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:52.569951 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c9827f23-0277-4dd5-aa67-d7144e9927ea tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:52.570712 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c9827f23-0277-4dd5-aa67-d7144e9927ea tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:52.571139 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c9827f23-0277-4dd5-aa67-d7144e9927ea tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:52.697986 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-c9827f23-0277-4dd5-aa67-d7144e9927ea tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:52.705972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-c9827f23-0277-4dd5-aa67-d7144e9927ea tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1721 microversion: 2.1 time: 0.147905 May 25 16:24:52.706538 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 261/527] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:52 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:52.966453 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-bb302947-10da-4d73-a5f0-65cd4a4e9dfd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:52.967512 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-bb302947-10da-4d73-a5f0-65cd4a4e9dfd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:52.973515 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-bb302947-10da-4d73-a5f0-65cd4a4e9dfd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:52.974002 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-bb302947-10da-4d73-a5f0-65cd4a4e9dfd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:52.974760 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-bb302947-10da-4d73-a5f0-65cd4a4e9dfd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:52.975195 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-bb302947-10da-4d73-a5f0-65cd4a4e9dfd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:53.005666 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-bb302947-10da-4d73-a5f0-65cd4a4e9dfd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043266 May 25 16:24:53.006244 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 267/528] 10.222.0.42 () {60 vars in 1342 bytes} [Wed May 25 16:24:52 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:53.063575 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-e9b258a8-ffaf-457d-9763-8da9f1e6be22 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:53.064118 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-e9b258a8-ffaf-457d-9763-8da9f1e6be22 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:53.070705 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e9b258a8-ffaf-457d-9763-8da9f1e6be22 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:53.071154 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e9b258a8-ffaf-457d-9763-8da9f1e6be22 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:53.071921 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e9b258a8-ffaf-457d-9763-8da9f1e6be22 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:53.072357 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e9b258a8-ffaf-457d-9763-8da9f1e6be22 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:53.097286 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-e9b258a8-ffaf-457d-9763-8da9f1e6be22 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Going to try to terminate instance {{(pid=117510) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:24:53.170052 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-e9b258a8-ffaf-457d-9763-8da9f1e6be22 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 204 len: 0 microversion: 2.20 time: 0.110456 May 25 16:24:53.171424 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 262/529] 10.222.0.42 () {60 vars in 1279 bytes} [Wed May 25 16:24:53 2022] DELETE /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 25 16:24:53.179506 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-02ef9ec6-dd8d-4e61-be90-3eb7237c7477 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:53.180132 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-02ef9ec6-dd8d-4e61-be90-3eb7237c7477 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:53.186158 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-02ef9ec6-dd8d-4e61-be90-3eb7237c7477 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:53.186598 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-02ef9ec6-dd8d-4e61-be90-3eb7237c7477 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:53.187345 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-02ef9ec6-dd8d-4e61-be90-3eb7237c7477 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:53.187773 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-02ef9ec6-dd8d-4e61-be90-3eb7237c7477 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:53.318407 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-02ef9ec6-dd8d-4e61-be90-3eb7237c7477 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:53.327596 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-02ef9ec6-dd8d-4e61-be90-3eb7237c7477 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:53.329066 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-02ef9ec6-dd8d-4e61-be90-3eb7237c7477 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:53.330240 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-02ef9ec6-dd8d-4e61-be90-3eb7237c7477 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1722 microversion: 2.20 time: 0.154553 May 25 16:24:53.330800 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 268/530] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:24:53 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:24:53.723245 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-bebce8fa-5b4c-4cec-8335-508bceff6c78 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:53.724182 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-bebce8fa-5b4c-4cec-8335-508bceff6c78 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:53.730397 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-bebce8fa-5b4c-4cec-8335-508bceff6c78 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:53.730843 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-bebce8fa-5b4c-4cec-8335-508bceff6c78 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:53.731824 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-bebce8fa-5b4c-4cec-8335-508bceff6c78 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:53.732494 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-bebce8fa-5b4c-4cec-8335-508bceff6c78 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:53.867155 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-bebce8fa-5b4c-4cec-8335-508bceff6c78 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:53.875855 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-bebce8fa-5b4c-4cec-8335-508bceff6c78 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1721 microversion: 2.1 time: 0.156677 May 25 16:24:53.876430 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 263/531] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:53 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:54.348328 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-4cb4f9da-7bb3-47cc-ae63-2a7193d0c894 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:54.348928 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-4cb4f9da-7bb3-47cc-ae63-2a7193d0c894 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:54.354998 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4cb4f9da-7bb3-47cc-ae63-2a7193d0c894 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:54.355433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4cb4f9da-7bb3-47cc-ae63-2a7193d0c894 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:54.356709 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4cb4f9da-7bb3-47cc-ae63-2a7193d0c894 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:54.357166 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4cb4f9da-7bb3-47cc-ae63-2a7193d0c894 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:54.488960 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-4cb4f9da-7bb3-47cc-ae63-2a7193d0c894 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:54.496912 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-4cb4f9da-7bb3-47cc-ae63-2a7193d0c894 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:54.498421 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-4cb4f9da-7bb3-47cc-ae63-2a7193d0c894 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:54.499558 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-4cb4f9da-7bb3-47cc-ae63-2a7193d0c894 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1722 microversion: 2.20 time: 0.155110 May 25 16:24:54.500105 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 269/532] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:24:54 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:24:54.893466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-8f22e508-4866-4a14-bf92-0c4f5456fdc3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:54.894070 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-8f22e508-4866-4a14-bf92-0c4f5456fdc3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:54.900451 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8f22e508-4866-4a14-bf92-0c4f5456fdc3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:54.900889 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8f22e508-4866-4a14-bf92-0c4f5456fdc3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:54.901637 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8f22e508-4866-4a14-bf92-0c4f5456fdc3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:54.902088 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8f22e508-4866-4a14-bf92-0c4f5456fdc3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:55.028750 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-8f22e508-4866-4a14-bf92-0c4f5456fdc3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:55.036636 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-8f22e508-4866-4a14-bf92-0c4f5456fdc3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1721 microversion: 2.1 time: 0.147039 May 25 16:24:55.037455 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 264/533] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:54 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:55.518730 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-3cdab8cc-b3f6-4cc0-a354-0f47b23ce94c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:55.519244 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-3cdab8cc-b3f6-4cc0-a354-0f47b23ce94c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:55.525276 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3cdab8cc-b3f6-4cc0-a354-0f47b23ce94c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:55.525739 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3cdab8cc-b3f6-4cc0-a354-0f47b23ce94c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:55.526505 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3cdab8cc-b3f6-4cc0-a354-0f47b23ce94c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:55.526939 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3cdab8cc-b3f6-4cc0-a354-0f47b23ce94c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:55.651859 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-3cdab8cc-b3f6-4cc0-a354-0f47b23ce94c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:55.656040 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:24:55.661494 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-3cdab8cc-b3f6-4cc0-a354-0f47b23ce94c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:55.663275 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-3cdab8cc-b3f6-4cc0-a354-0f47b23ce94c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:55.664411 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-3cdab8cc-b3f6-4cc0-a354-0f47b23ce94c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1722 microversion: 2.20 time: 0.150000 May 25 16:24:55.664988 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 270/534] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:24:55 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:24:56.056751 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-8c6d6724-5c80-4a7d-b1f5-f506fc3a4d85 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:56.057652 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-8c6d6724-5c80-4a7d-b1f5-f506fc3a4d85 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:56.067924 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8c6d6724-5c80-4a7d-b1f5-f506fc3a4d85 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:56.068379 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8c6d6724-5c80-4a7d-b1f5-f506fc3a4d85 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:56.069799 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8c6d6724-5c80-4a7d-b1f5-f506fc3a4d85 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:56.070243 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8c6d6724-5c80-4a7d-b1f5-f506fc3a4d85 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:56.077559 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:24:56.231751 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-8c6d6724-5c80-4a7d-b1f5-f506fc3a4d85 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:56.239852 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-8c6d6724-5c80-4a7d-b1f5-f506fc3a4d85 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1727 microversion: 2.1 time: 0.188229 May 25 16:24:56.240427 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 265/535] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:24:56 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1727 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:24:56.261832 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-4033e811-5491-4efb-8025-9f3ddba96fd1 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:56.262323 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-4033e811-5491-4efb-8025-9f3ddba96fd1 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:56.270886 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4033e811-5491-4efb-8025-9f3ddba96fd1 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:56.271325 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4033e811-5491-4efb-8025-9f3ddba96fd1 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:56.272082 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4033e811-5491-4efb-8025-9f3ddba96fd1 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:56.272505 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4033e811-5491-4efb-8025-9f3ddba96fd1 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:56.360768 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-4033e811-5491-4efb-8025-9f3ddba96fd1 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104174 May 25 16:24:56.361485 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 271/536] 10.222.0.42 () {58 vars in 1274 bytes} [Wed May 25 16:24:56 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:24:56.683014 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-f2b4d48a-eeab-463b-af49-0982df2d5cc8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:56.684419 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-f2b4d48a-eeab-463b-af49-0982df2d5cc8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:56.691756 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f2b4d48a-eeab-463b-af49-0982df2d5cc8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:56.692203 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f2b4d48a-eeab-463b-af49-0982df2d5cc8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:56.693061 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f2b4d48a-eeab-463b-af49-0982df2d5cc8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:56.693661 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f2b4d48a-eeab-463b-af49-0982df2d5cc8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:56.776783 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-f2b4d48a-eeab-463b-af49-0982df2d5cc8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:56.785517 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-f2b4d48a-eeab-463b-af49-0982df2d5cc8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:56.787297 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-f2b4d48a-eeab-463b-af49-0982df2d5cc8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:24:56.788465 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-f2b4d48a-eeab-463b-af49-0982df2d5cc8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 200 len: 1655 microversion: 2.20 time: 0.109408 May 25 16:24:56.794345 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 266/537] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:24:56 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 1655 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:24:56.886708 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-2d9856b1-1fd8-44e1-b613-5b7438e8795f req-37b5670b-04d8-431d-ae19-27c5f8e9e27b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3da72ce-f083-455e-ae40-9530c53126ef", "name": "network-vif-deleted", "tag": "81d48be3-f76c-4118-bcaa-79360428da5a"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:24:56.895851 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-2d9856b1-1fd8-44e1-b613-5b7438e8795f req-37b5670b-04d8-431d-ae19-27c5f8e9e27b service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:56.896595 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-2d9856b1-1fd8-44e1-b613-5b7438e8795f req-37b5670b-04d8-431d-ae19-27c5f8e9e27b service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:56.910803 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-2d9856b1-1fd8-44e1-b613-5b7438e8795f req-37b5670b-04d8-431d-ae19-27c5f8e9e27b service nova] Creating event network-vif-deleted:81d48be3-f76c-4118-bcaa-79360428da5a for instance d3da72ce-f083-455e-ae40-9530c53126ef on hv-cinder-84327 May 25 16:24:56.916668 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-2d9856b1-1fd8-44e1-b613-5b7438e8795f req-37b5670b-04d8-431d-ae19-27c5f8e9e27b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033550 May 25 16:24:56.917407 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 272/538] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:24:57.391177 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-72fa359a-58c7-4c08-8b34-1ab8462b61bd req-01449f1f-1aaa-4643-a22c-c3d0dbf3c14f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f68f3730-3984-4aef-9c58-e87b09051c87", "tag": "1b194465-a3bb-473d-8825-aed33ba4c44a"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:24:57.413520 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-72fa359a-58c7-4c08-8b34-1ab8462b61bd req-01449f1f-1aaa-4643-a22c-c3d0dbf3c14f service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:57.414077 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-72fa359a-58c7-4c08-8b34-1ab8462b61bd req-01449f1f-1aaa-4643-a22c-c3d0dbf3c14f service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:57.435199 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-72fa359a-58c7-4c08-8b34-1ab8462b61bd req-01449f1f-1aaa-4643-a22c-c3d0dbf3c14f service nova] Creating event network-changed:1b194465-a3bb-473d-8825-aed33ba4c44a for instance f68f3730-3984-4aef-9c58-e87b09051c87 on hv-cinder-84327 May 25 16:24:57.440183 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-72fa359a-58c7-4c08-8b34-1ab8462b61bd req-01449f1f-1aaa-4643-a22c-c3d0dbf3c14f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053118 May 25 16:24:57.441463 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 267/539] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:24:57.808542 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-58411812-93e6-425b-8e62-0344c001227f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:57.810388 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-58411812-93e6-425b-8e62-0344c001227f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:24:57.817131 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-58411812-93e6-425b-8e62-0344c001227f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:57.817581 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-58411812-93e6-425b-8e62-0344c001227f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:57.818406 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-58411812-93e6-425b-8e62-0344c001227f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:57.819037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-58411812-93e6-425b-8e62-0344c001227f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:57.837878 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.wsgi [None req-58411812-93e6-425b-8e62-0344c001227f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] HTTP exception thrown: Instance d3da72ce-f083-455e-ae40-9530c53126ef could not be found. May 25 16:24:57.839752 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-58411812-93e6-425b-8e62-0344c001227f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Request method failure captured: May 25 16:24:57.839752 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef HTTP/1.1 May 25 16:24:57.839752 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:24:57.839752 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:24:57.839752 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:24:57.839752 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 0 May 25 16:24:57.839752 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:24:57.839752 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:24:57.839752 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:24:57.839752 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:24:57.839752 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijldbuv6RCYGKoWwJhN6lRmiU70u8cExXqiSTujenf4slPFEDO2l80YAOnHkbj2OhZY3H4OpUSOAxkbmdwCFbXSYUM1V7OOl5sy1rYoEnzomPg28PrGegcvWSA5ApSGv5egQo_Ac61surIon3gcAZJlCzkLOUqq0u1u2qejLAHQh9k3w May 25 16:24:57.839752 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:24:57.839752 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:24:57.839752 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:24:57.839752 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:24:57.839752 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Openstack-Nova-Api-Version: 2.20 May 25 16:24:57.839752 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:24:57.839752 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:24:57.839752 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: e916473814d44ac1ae6339f0d052daa1 May 25 16:24:57.839752 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1285056380 May 25 16:24:57.839752 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:24:57.839752 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:24:57.842085 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e916473814d44ac1ae6339f0d052daa1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e916473814d44ac1ae6339f0d052daa1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e916473814d44ac1ae6339f0d052daa1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e916473814d44ac1ae6339f0d052daa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:24:57.842085 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1285056380 May 25 16:24:57.842085 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: e916473814d44ac1ae6339f0d052daa1 May 25 16:24:57.842085 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1285056380 May 25 16:24:57.842085 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-AttachVolumeShelveTestJSON-1285056380-project May 25 16:24:57.842085 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:24:57.842085 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:24:57.842085 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: 9178e89a790d48d19b25c4c22bd0ca4e May 25 16:24:57.842085 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1285056380-project May 25 16:24:57.842085 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: > May 25 16:24:57.842085 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Instance d3da72ce-f083-455e-ae40-9530c53126ef could not be found. May 25 16:24:57.842085 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'id': 'd3da72ce-f083-455e-ae40-9530c53126ef'} May 25 16:24:57.843004 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:24:57.843004 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:24:57.843004 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:24:57.843004 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:24:57.843004 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:24:57.843004 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:24:57.843004 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:24:57.843004 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:24:57.843004 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:24:57.843004 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:24:57.843004 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3da72ce-f083-455e-ae40-9530c53126ef could not be found. May 25 16:24:57.843004 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:24:57.843004 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:24:57.843004 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:24:57.843004 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:24:57.843004 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:24:57.843004 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:24:57.843004 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:24:57.843004 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:24:57.843004 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:24:57.844433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:24:57.844433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:24:57.844433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:24:57.844433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:24:57.844433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:24:57.844433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:24:57.844433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:24:57.844433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3da72ce-f083-455e-ae40-9530c53126ef could not be found. May 25 16:24:57.844433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:24:57.844433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:24:57.844433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:24:57.844433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:24:57.844433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:24:57.844433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:24:57.844433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:24:57.844433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:24:57.844433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3da72ce-f083-455e-ae40-9530c53126ef could not be found. May 25 16:24:57.844433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:24:57.847421 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-58411812-93e6-425b-8e62-0344c001227f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Returning 404 to user: Instance d3da72ce-f083-455e-ae40-9530c53126ef could not be found. {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:24:57.848456 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-58411812-93e6-425b-8e62-0344c001227f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 404 len: 111 microversion: 2.20 time: 0.044473 May 25 16:24:57.852666 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 273/540] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:24:57 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 25 16:24:57.859382 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-5381240c-0cdb-4583-8c2e-bebba4a614ab tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '.version_select at 0x7f51ed967700>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:24:57.884204 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-5381240c-0cdb-4583-8c2e-bebba4a614ab tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-456065417" status: 204 len: 0 microversion: 2.20 time: 0.029487 May 25 16:24:57.885020 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 268/541] 10.222.0.42 () {60 vars in 1258 bytes} [Wed May 25 16:24:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-456065417 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 25 16:24:58.560208 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-01fbf0ac-d751-4eb9-9c81-51033d7542ef tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Action: 'create', calling method: .version_select at 0x7f51ee16b9d0>, body: {"keypair": {"name": "tempest-keypair-2042314323", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmp6D1TNQAmUu8/09892h/bZMieQH6lmHvWJPkV8HH6etIWtj1CJgaHC/rO0NwBtbYbq8G4oD5Yl3mtEBfTEaR1+rN8/3zy2Y51wuvj5/E3z3OereMr0gg2RtcCDYjYPw=="}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:24:58.573668 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-01fbf0ac-d751-4eb9-9c81-51033d7542ef tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Getting quotas for project e916473814d44ac1ae6339f0d052daa1. Resources: {'key_pairs'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:24:58.577741 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-01fbf0ac-d751-4eb9-9c81-51033d7542ef tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Getting quotas for user 9178e89a790d48d19b25c4c22bd0ca4e and project e916473814d44ac1ae6339f0d052daa1. Resources: {'key_pairs'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:24:58.599440 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-01fbf0ac-d751-4eb9-9c81-51033d7542ef tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.043405 May 25 16:24:58.600004 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 274/542] 10.222.0.42 () {62 vars in 1199 bytes} [Wed May 25 16:24:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 45 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 25 16:24:59.456869 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-ef74889d-55c7-4d24-b1ac-e6e58da23b7c req-5f2a19f9-2f4a-40c4-a182-2ad2bc4b4608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f68f3730-3984-4aef-9c58-e87b09051c87", "tag": "1b194465-a3bb-473d-8825-aed33ba4c44a"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:24:59.466220 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-ef74889d-55c7-4d24-b1ac-e6e58da23b7c req-5f2a19f9-2f4a-40c4-a182-2ad2bc4b4608 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:24:59.466911 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-ef74889d-55c7-4d24-b1ac-e6e58da23b7c req-5f2a19f9-2f4a-40c4-a182-2ad2bc4b4608 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:24:59.478761 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-ef74889d-55c7-4d24-b1ac-e6e58da23b7c req-5f2a19f9-2f4a-40c4-a182-2ad2bc4b4608 service nova] Creating event network-changed:1b194465-a3bb-473d-8825-aed33ba4c44a for instance f68f3730-3984-4aef-9c58-e87b09051c87 on hv-cinder-84327 May 25 16:24:59.484375 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-ef74889d-55c7-4d24-b1ac-e6e58da23b7c req-5f2a19f9-2f4a-40c4-a182-2ad2bc4b4608 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032165 May 25 16:24:59.485051 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 269/543] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:25:00.122944 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-1c956ae6-3c75-4de5-ba37-636c15f92032 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-917960555", "imageRef": "e74cccc1-cd1b-4dfc-8e47-3e4a832649a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b9fb8be-8c67-427e-8c91-a4becd42df59"}], "security_groups": [{"name": "tempest-securitygroup--993968060"}], "key_name": "tempest-keypair-2042314323", "user_data": "}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:25:00.239082 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.network.neutron [None req-1c956ae6-3c75-4de5-ba37-636c15f92032 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] validate_networks() for [('4b9fb8be-8c67-427e-8c91-a4becd42df59', None, None, None, None, None)] {{(pid=117509) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:25:00.595361 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-1c956ae6-3c75-4de5-ba37-636c15f92032 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Flavor limits 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:25:00.595730 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-1c956ae6-3c75-4de5-ba37-636c15f92032 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Image limits 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:25:00.596199 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-1c956ae6-3c75-4de5-ba37-636c15f92032 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Flavor pref 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:25:00.596607 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-1c956ae6-3c75-4de5-ba37-636c15f92032 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Image pref 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:25:00.597013 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-1c956ae6-3c75-4de5-ba37-636c15f92032 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:25:00.606745 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1c956ae6-3c75-4de5-ba37-636c15f92032 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:00.607422 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1c956ae6-3c75-4de5-ba37-636c15f92032 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:00.608334 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1c956ae6-3c75-4de5-ba37-636c15f92032 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:00.608773 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1c956ae6-3c75-4de5-ba37-636c15f92032 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:00.626511 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-1c956ae6-3c75-4de5-ba37-636c15f92032 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Getting quotas for project e916473814d44ac1ae6339f0d052daa1. Resources: {'ram', 'cores', 'instances'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:25:00.630428 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-1c956ae6-3c75-4de5-ba37-636c15f92032 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Getting quotas for user 9178e89a790d48d19b25c4c22bd0ca4e and project e916473814d44ac1ae6339f0d052daa1. Resources: {'ram', 'cores', 'instances'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:25:00.641999 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-1c956ae6-3c75-4de5-ba37-636c15f92032 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Going to run 1 instances... {{(pid=117509) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:25:00.644223 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-1c956ae6-3c75-4de5-ba37-636c15f92032 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e74cccc1-cd1b-4dfc-8e47-3e4a832649a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:25:00.691277 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-1c956ae6-3c75-4de5-ba37-636c15f92032 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.573129 May 25 16:25:00.692116 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 275/544] 10.222.0.42 () {62 vars in 1187 bytes} [Wed May 25 16:25:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 25 16:25:00.703742 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-9771b8e4-40e6-4571-9218-3e9ddb136614 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:00.704443 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-9771b8e4-40e6-4571-9218-3e9ddb136614 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:00.757877 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-9771b8e4-40e6-4571-9218-3e9ddb136614 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:00.765813 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-9771b8e4-40e6-4571-9218-3e9ddb136614 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:00.767303 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-9771b8e4-40e6-4571-9218-3e9ddb136614 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:00.768380 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-9771b8e4-40e6-4571-9218-3e9ddb136614 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1281 microversion: 2.20 time: 0.070035 May 25 16:25:00.768923 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 270/545] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:25:00 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1281 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:25:01.788468 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-07d4e88c-74ce-48f8-9498-aff5b090c41d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:01.789187 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-07d4e88c-74ce-48f8-9498-aff5b090c41d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:01.798014 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-07d4e88c-74ce-48f8-9498-aff5b090c41d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:01.798708 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-07d4e88c-74ce-48f8-9498-aff5b090c41d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:01.799559 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-07d4e88c-74ce-48f8-9498-aff5b090c41d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:01.800311 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-07d4e88c-74ce-48f8-9498-aff5b090c41d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:01.867467 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-07d4e88c-74ce-48f8-9498-aff5b090c41d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:01.876290 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-07d4e88c-74ce-48f8-9498-aff5b090c41d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:01.877916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-07d4e88c-74ce-48f8-9498-aff5b090c41d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:01.879011 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-07d4e88c-74ce-48f8-9498-aff5b090c41d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1339 microversion: 2.20 time: 0.096443 May 25 16:25:01.879557 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 276/546] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:25:01 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1339 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:25:02.897497 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-88a2d198-d166-49df-9d98-bfac955da5c4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:02.898125 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-88a2d198-d166-49df-9d98-bfac955da5c4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:02.905920 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-88a2d198-d166-49df-9d98-bfac955da5c4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:02.906376 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-88a2d198-d166-49df-9d98-bfac955da5c4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:02.907146 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-88a2d198-d166-49df-9d98-bfac955da5c4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:02.907724 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-88a2d198-d166-49df-9d98-bfac955da5c4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:03.039601 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-88a2d198-d166-49df-9d98-bfac955da5c4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:03.049705 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-88a2d198-d166-49df-9d98-bfac955da5c4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:03.051710 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-88a2d198-d166-49df-9d98-bfac955da5c4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:03.052971 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-88a2d198-d166-49df-9d98-bfac955da5c4 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1406 microversion: 2.20 time: 0.159388 May 25 16:25:03.053534 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 271/547] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:25:02 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:25:03.269025 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-be09a819-389a-4cbe-8de4-713d5b7e3bdf req-2d853c93-bbe2-4a59-8f13-0d04f82c3e39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7652df85-9116-41c0-b1a1-32a070414bd8", "tag": "3be8d920-dc13-499f-b9d6-d875dbb50bdc"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:25:03.277457 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-be09a819-389a-4cbe-8de4-713d5b7e3bdf req-2d853c93-bbe2-4a59-8f13-0d04f82c3e39 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:03.278503 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-be09a819-389a-4cbe-8de4-713d5b7e3bdf req-2d853c93-bbe2-4a59-8f13-0d04f82c3e39 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:03.292275 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-be09a819-389a-4cbe-8de4-713d5b7e3bdf req-2d853c93-bbe2-4a59-8f13-0d04f82c3e39 service nova] Creating event network-changed:3be8d920-dc13-499f-b9d6-d875dbb50bdc for instance 7652df85-9116-41c0-b1a1-32a070414bd8 on hv-cinder-84327 May 25 16:25:03.298070 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-be09a819-389a-4cbe-8de4-713d5b7e3bdf req-2d853c93-bbe2-4a59-8f13-0d04f82c3e39 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032679 May 25 16:25:03.298668 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 277/548] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:25:04.072086 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-64fbd4c5-cd12-4fd6-b342-5882d04135ce tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:04.072668 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-64fbd4c5-cd12-4fd6-b342-5882d04135ce tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:04.079705 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-64fbd4c5-cd12-4fd6-b342-5882d04135ce tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:04.080148 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-64fbd4c5-cd12-4fd6-b342-5882d04135ce tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:04.080902 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-64fbd4c5-cd12-4fd6-b342-5882d04135ce tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:04.081337 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-64fbd4c5-cd12-4fd6-b342-5882d04135ce tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:04.206342 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-64fbd4c5-cd12-4fd6-b342-5882d04135ce tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:04.214032 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-64fbd4c5-cd12-4fd6-b342-5882d04135ce tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:04.216098 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-64fbd4c5-cd12-4fd6-b342-5882d04135ce tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:04.217184 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-64fbd4c5-cd12-4fd6-b342-5882d04135ce tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1406 microversion: 2.20 time: 0.149050 May 25 16:25:04.217784 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 272/549] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:25:04 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:25:05.235836 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-904eec6c-aee1-4257-a66f-7a961e5564c1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:05.236872 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-904eec6c-aee1-4257-a66f-7a961e5564c1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:05.243670 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-904eec6c-aee1-4257-a66f-7a961e5564c1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:05.244161 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-904eec6c-aee1-4257-a66f-7a961e5564c1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:05.244913 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-904eec6c-aee1-4257-a66f-7a961e5564c1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:05.245378 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-904eec6c-aee1-4257-a66f-7a961e5564c1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:05.381338 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-904eec6c-aee1-4257-a66f-7a961e5564c1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:05.389228 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-904eec6c-aee1-4257-a66f-7a961e5564c1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:05.390759 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-904eec6c-aee1-4257-a66f-7a961e5564c1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:05.391851 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-904eec6c-aee1-4257-a66f-7a961e5564c1 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1406 microversion: 2.20 time: 0.161117 May 25 16:25:05.392408 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 278/550] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:25:05 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:25:06.409638 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-3383a58a-8d8f-4267-97ac-c17b9d55d736 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:06.410250 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-3383a58a-8d8f-4267-97ac-c17b9d55d736 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:06.417104 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3383a58a-8d8f-4267-97ac-c17b9d55d736 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:06.417557 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3383a58a-8d8f-4267-97ac-c17b9d55d736 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:06.419074 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3383a58a-8d8f-4267-97ac-c17b9d55d736 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:06.419484 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3383a58a-8d8f-4267-97ac-c17b9d55d736 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:06.557883 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-3383a58a-8d8f-4267-97ac-c17b9d55d736 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:06.566527 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-3383a58a-8d8f-4267-97ac-c17b9d55d736 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:06.568026 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-3383a58a-8d8f-4267-97ac-c17b9d55d736 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:06.569116 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-3383a58a-8d8f-4267-97ac-c17b9d55d736 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1406 microversion: 2.20 time: 0.163446 May 25 16:25:06.569665 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 273/551] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:25:06 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:25:07.589701 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-28ddbd6b-ee69-429d-b54d-cf1eb5c71ffa tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:07.590830 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-28ddbd6b-ee69-429d-b54d-cf1eb5c71ffa tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:07.601207 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-28ddbd6b-ee69-429d-b54d-cf1eb5c71ffa tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:07.602067 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-28ddbd6b-ee69-429d-b54d-cf1eb5c71ffa tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:07.603398 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-28ddbd6b-ee69-429d-b54d-cf1eb5c71ffa tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:07.603837 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-28ddbd6b-ee69-429d-b54d-cf1eb5c71ffa tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:07.729843 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-28ddbd6b-ee69-429d-b54d-cf1eb5c71ffa tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:07.738201 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-28ddbd6b-ee69-429d-b54d-cf1eb5c71ffa tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:07.739695 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-28ddbd6b-ee69-429d-b54d-cf1eb5c71ffa tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:07.740788 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-28ddbd6b-ee69-429d-b54d-cf1eb5c71ffa tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1406 microversion: 2.20 time: 0.157845 May 25 16:25:07.741339 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 279/552] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:25:07 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:25:08.758725 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-c1ce5c35-f293-4926-aeb4-82add91125cf tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:08.759329 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-c1ce5c35-f293-4926-aeb4-82add91125cf tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:08.765922 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c1ce5c35-f293-4926-aeb4-82add91125cf tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:08.766375 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c1ce5c35-f293-4926-aeb4-82add91125cf tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:08.767131 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c1ce5c35-f293-4926-aeb4-82add91125cf tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:08.767574 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c1ce5c35-f293-4926-aeb4-82add91125cf tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:08.900566 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-c1ce5c35-f293-4926-aeb4-82add91125cf tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:08.908597 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-c1ce5c35-f293-4926-aeb4-82add91125cf tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:08.910143 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-c1ce5c35-f293-4926-aeb4-82add91125cf tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:08.911227 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-c1ce5c35-f293-4926-aeb4-82add91125cf tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1406 microversion: 2.20 time: 0.156528 May 25 16:25:08.911786 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 274/553] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:25:08 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:25:09.855482 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-64c81300-d237-4b3d-a1c5-12f8e9743f03 req-f18255c5-fbc3-40c2-9fca-68f86a6b3e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7652df85-9116-41c0-b1a1-32a070414bd8", "name": "network-vif-plugged", "status": "completed", "tag": "3be8d920-dc13-499f-b9d6-d875dbb50bdc"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:25:09.864570 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-64c81300-d237-4b3d-a1c5-12f8e9743f03 req-f18255c5-fbc3-40c2-9fca-68f86a6b3e6f service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:09.864998 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-64c81300-d237-4b3d-a1c5-12f8e9743f03 req-f18255c5-fbc3-40c2-9fca-68f86a6b3e6f service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:09.876840 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-64c81300-d237-4b3d-a1c5-12f8e9743f03 req-f18255c5-fbc3-40c2-9fca-68f86a6b3e6f service nova] Creating event network-vif-plugged:3be8d920-dc13-499f-b9d6-d875dbb50bdc for instance 7652df85-9116-41c0-b1a1-32a070414bd8 on hv-cinder-84327 May 25 16:25:09.881604 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-64c81300-d237-4b3d-a1c5-12f8e9743f03 req-f18255c5-fbc3-40c2-9fca-68f86a6b3e6f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029817 May 25 16:25:09.882274 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 280/554] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:25:09.929386 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-3efcf298-66d5-4bfc-bfac-6666dc77af40 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:09.930018 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-3efcf298-66d5-4bfc-bfac-6666dc77af40 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:09.936623 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3efcf298-66d5-4bfc-bfac-6666dc77af40 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:09.937072 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3efcf298-66d5-4bfc-bfac-6666dc77af40 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:09.937869 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3efcf298-66d5-4bfc-bfac-6666dc77af40 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:09.938306 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3efcf298-66d5-4bfc-bfac-6666dc77af40 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:10.075874 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-3efcf298-66d5-4bfc-bfac-6666dc77af40 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:10.083816 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-3efcf298-66d5-4bfc-bfac-6666dc77af40 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:10.085314 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-3efcf298-66d5-4bfc-bfac-6666dc77af40 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:10.086433 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-3efcf298-66d5-4bfc-bfac-6666dc77af40 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1406 microversion: 2.20 time: 0.160900 May 25 16:25:10.086992 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 275/555] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:25:09 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:25:11.102106 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell0:SELECT=2 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:25:11.102814 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell0:SELECT=10 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:25:11.107727 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-3d0a175a-78b9-423b-adee-c968360eca02 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:11.108412 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-3d0a175a-78b9-423b-adee-c968360eca02 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:11.115379 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3d0a175a-78b9-423b-adee-c968360eca02 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:11.115816 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3d0a175a-78b9-423b-adee-c968360eca02 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:11.116562 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3d0a175a-78b9-423b-adee-c968360eca02 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:11.116990 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3d0a175a-78b9-423b-adee-c968360eca02 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:11.250030 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-3d0a175a-78b9-423b-adee-c968360eca02 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:11.259565 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-3d0a175a-78b9-423b-adee-c968360eca02 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:11.261055 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-3d0a175a-78b9-423b-adee-c968360eca02 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:11.262192 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-3d0a175a-78b9-423b-adee-c968360eca02 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1406 microversion: 2.20 time: 0.161202 May 25 16:25:11.262747 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 281/556] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:25:11 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:25:12.279201 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-577aaa48-7d2c-43d3-b1a7-466fd26ef472 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:12.279736 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-577aaa48-7d2c-43d3-b1a7-466fd26ef472 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:12.281631 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell0:SELECT=2 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:25:12.287595 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-577aaa48-7d2c-43d3-b1a7-466fd26ef472 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:12.288042 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-577aaa48-7d2c-43d3-b1a7-466fd26ef472 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:12.288903 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-577aaa48-7d2c-43d3-b1a7-466fd26ef472 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:12.289348 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-577aaa48-7d2c-43d3-b1a7-466fd26ef472 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:12.415782 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-577aaa48-7d2c-43d3-b1a7-466fd26ef472 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:12.424203 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-577aaa48-7d2c-43d3-b1a7-466fd26ef472 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:12.425757 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-577aaa48-7d2c-43d3-b1a7-466fd26ef472 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:12.426920 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-577aaa48-7d2c-43d3-b1a7-466fd26ef472 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1599 microversion: 2.20 time: 0.151743 May 25 16:25:12.427471 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 276/557] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:25:12 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:25:12.445247 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-562e83fe-cc31-4aef-8014-76885d35d886 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:12.445752 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-562e83fe-cc31-4aef-8014-76885d35d886 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:12.452131 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-562e83fe-cc31-4aef-8014-76885d35d886 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:12.452567 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-562e83fe-cc31-4aef-8014-76885d35d886 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:12.453340 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-562e83fe-cc31-4aef-8014-76885d35d886 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:12.453790 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-562e83fe-cc31-4aef-8014-76885d35d886 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:12.529621 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-562e83fe-cc31-4aef-8014-76885d35d886 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.088132 May 25 16:25:12.530184 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 282/558] 10.222.0.42 () {60 vars in 1315 bytes} [Wed May 25 16:25:12 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:25:13.667171 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-2233cf01-e050-4724-9fdd-2dc010671226 req-4aaa954a-9613-4d13-a0f4-a0e97cbaaafb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7652df85-9116-41c0-b1a1-32a070414bd8", "tag": "3be8d920-dc13-499f-b9d6-d875dbb50bdc"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:25:13.676613 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-2233cf01-e050-4724-9fdd-2dc010671226 req-4aaa954a-9613-4d13-a0f4-a0e97cbaaafb service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:13.677132 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-2233cf01-e050-4724-9fdd-2dc010671226 req-4aaa954a-9613-4d13-a0f4-a0e97cbaaafb service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:13.688970 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-2233cf01-e050-4724-9fdd-2dc010671226 req-4aaa954a-9613-4d13-a0f4-a0e97cbaaafb service nova] Creating event network-changed:3be8d920-dc13-499f-b9d6-d875dbb50bdc for instance 7652df85-9116-41c0-b1a1-32a070414bd8 on hv-cinder-84327 May 25 16:25:13.693950 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-2233cf01-e050-4724-9fdd-2dc010671226 req-4aaa954a-9613-4d13-a0f4-a0e97cbaaafb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030401 May 25 16:25:13.694540 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 277/559] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:25:34.673434 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:25:34.674214 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=42 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:25:34.679069 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-10dac5e5-7834-4d70-abb1-d554268b0d9f tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:34.679967 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-10dac5e5-7834-4d70-abb1-d554268b0d9f tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:34.688633 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-10dac5e5-7834-4d70-abb1-d554268b0d9f tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:34.689019 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-10dac5e5-7834-4d70-abb1-d554268b0d9f tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:34.689911 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-10dac5e5-7834-4d70-abb1-d554268b0d9f tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:34.690347 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-10dac5e5-7834-4d70-abb1-d554268b0d9f tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:34.719150 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-10dac5e5-7834-4d70-abb1-d554268b0d9f tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046530 May 25 16:25:34.719694 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 283/560] 10.222.0.42 () {58 vars in 1301 bytes} [Wed May 25 16:25:34 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 16:25:34.775616 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:25:34.776352 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=52 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:25:34.781064 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-5169c158-766f-4f2c-a41e-76fa96880d11 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:34.781652 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-5169c158-766f-4f2c-a41e-76fa96880d11 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:34.789784 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5169c158-766f-4f2c-a41e-76fa96880d11 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:34.790240 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5169c158-766f-4f2c-a41e-76fa96880d11 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:34.790997 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5169c158-766f-4f2c-a41e-76fa96880d11 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:34.791436 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5169c158-766f-4f2c-a41e-76fa96880d11 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:34.819294 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-5169c158-766f-4f2c-a41e-76fa96880d11 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Going to try to terminate instance {{(pid=117510) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:25:34.896067 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-5169c158-766f-4f2c-a41e-76fa96880d11 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 204 len: 0 microversion: 2.1 time: 0.121886 May 25 16:25:34.896685 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 278/561] 10.222.0.42 () {58 vars in 1238 bytes} [Wed May 25 16:25:34 2022] DELETE /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:25:34.905546 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-c09d7ce7-8e7d-4ced-8fe0-19a5e360e1bc tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:34.906457 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-c09d7ce7-8e7d-4ced-8fe0-19a5e360e1bc tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:34.914175 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c09d7ce7-8e7d-4ced-8fe0-19a5e360e1bc tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:34.914626 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c09d7ce7-8e7d-4ced-8fe0-19a5e360e1bc tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:34.915391 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c09d7ce7-8e7d-4ced-8fe0-19a5e360e1bc tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:34.915827 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c09d7ce7-8e7d-4ced-8fe0-19a5e360e1bc tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:34.973909 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-98fb6a86-eb51-46dd-8e91-6964d3a7f6db tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:34.974406 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-98fb6a86-eb51-46dd-8e91-6964d3a7f6db tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:34.981415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-98fb6a86-eb51-46dd-8e91-6964d3a7f6db tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:34.981888 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-98fb6a86-eb51-46dd-8e91-6964d3a7f6db tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:34.982657 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-98fb6a86-eb51-46dd-8e91-6964d3a7f6db tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:34.983102 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-98fb6a86-eb51-46dd-8e91-6964d3a7f6db tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:35.006820 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-98fb6a86-eb51-46dd-8e91-6964d3a7f6db tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af/ips" status: 200 len: 150 microversion: 2.1 time: 0.160808 May 25 16:25:35.007708 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 284/562] 10.222.0.42 () {58 vars in 1247 bytes} [Wed May 25 16:25:34 2022] GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af/ips => generated 150 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:25:35.155431 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-c09d7ce7-8e7d-4ced-8fe0-19a5e360e1bc tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:35.163340 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-c09d7ce7-8e7d-4ced-8fe0-19a5e360e1bc tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1673 microversion: 2.1 time: 0.262261 May 25 16:25:35.163898 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 279/563] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:34 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1673 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:25:36.180798 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-1e6ae5c0-4596-4155-bb4b-1dc49f076cc2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:36.181384 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-1e6ae5c0-4596-4155-bb4b-1dc49f076cc2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:36.187613 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1e6ae5c0-4596-4155-bb4b-1dc49f076cc2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:36.188150 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1e6ae5c0-4596-4155-bb4b-1dc49f076cc2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:36.188970 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1e6ae5c0-4596-4155-bb4b-1dc49f076cc2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:36.189432 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1e6ae5c0-4596-4155-bb4b-1dc49f076cc2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:36.331095 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-69027913-2c73-4cf9-8e7b-86f5b0e82c64 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3bbecd9-0b4a-462d-bff8-41757c8279cf"}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:25:36.332162 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-69027913-2c73-4cf9-8e7b-86f5b0e82c64 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:36.339041 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-69027913-2c73-4cf9-8e7b-86f5b0e82c64 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:36.339498 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-69027913-2c73-4cf9-8e7b-86f5b0e82c64 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:36.341067 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-69027913-2c73-4cf9-8e7b-86f5b0e82c64 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:36.341582 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-69027913-2c73-4cf9-8e7b-86f5b0e82c64 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:36.378142 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-1e6ae5c0-4596-4155-bb4b-1dc49f076cc2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:36.385813 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-1e6ae5c0-4596-4155-bb4b-1dc49f076cc2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1673 microversion: 2.1 time: 0.208807 May 25 16:25:36.386963 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 285/564] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:36 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1673 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:37.403627 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-08adc655-0866-4f99-9e12-4242929c2f8a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:37.404314 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-08adc655-0866-4f99-9e12-4242929c2f8a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:37.410780 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-08adc655-0866-4f99-9e12-4242929c2f8a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:37.411224 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-08adc655-0866-4f99-9e12-4242929c2f8a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:37.412230 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-08adc655-0866-4f99-9e12-4242929c2f8a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:37.412653 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-08adc655-0866-4f99-9e12-4242929c2f8a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:37.516222 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-69027913-2c73-4cf9-8e7b-86f5b0e82c64 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "POST /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.189202 May 25 16:25:37.517153 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 280/565] 10.222.0.42 () {60 vars in 1322 bytes} [Wed May 25 16:25:36 2022] POST /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af/os-volume_attachments => generated 194 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:25:37.563484 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-08adc655-0866-4f99-9e12-4242929c2f8a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:37.571131 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-08adc655-0866-4f99-9e12-4242929c2f8a tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1673 microversion: 2.1 time: 0.171775 May 25 16:25:37.571689 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 286/566] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:37 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:25:38.228959 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-24d812e4-b4b7-405e-8b65-13c89edc20e8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:38.229542 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-24d812e4-b4b7-405e-8b65-13c89edc20e8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:38.238441 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-24d812e4-b4b7-405e-8b65-13c89edc20e8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:38.239046 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-24d812e4-b4b7-405e-8b65-13c89edc20e8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:38.240030 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-24d812e4-b4b7-405e-8b65-13c89edc20e8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:38.240605 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-24d812e4-b4b7-405e-8b65-13c89edc20e8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:38.375453 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.objects.instance [None req-24d812e4-b4b7-405e-8b65-13c89edc20e8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lazy-loading 'services' on Instance uuid f68f3730-3984-4aef-9c58-e87b09051c87 {{(pid=117510) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:25:38.495456 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-24d812e4-b4b7-405e-8b65-13c89edc20e8 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87/os-volume_attachments/1d650010-f487-44a8-84e4-92ec565504b5" status: 202 len: 0 microversion: 2.1 time: 0.273990 May 25 16:25:38.496209 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 281/567] 10.222.0.42 () {58 vars in 1415 bytes} [Wed May 25 16:25:38 2022] DELETE /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87/os-volume_attachments/1d650010-f487-44a8-84e4-92ec565504b5 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:25:38.504715 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-75ce821b-f43b-4222-849a-08a2fea539e2 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:38.505683 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-75ce821b-f43b-4222-849a-08a2fea539e2 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:38.521337 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-75ce821b-f43b-4222-849a-08a2fea539e2 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:38.522032 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-75ce821b-f43b-4222-849a-08a2fea539e2 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:38.523153 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-75ce821b-f43b-4222-849a-08a2fea539e2 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:38.523694 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-75ce821b-f43b-4222-849a-08a2fea539e2 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:38.563771 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-75ce821b-f43b-4222-849a-08a2fea539e2 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063061 May 25 16:25:38.564395 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 287/568] 10.222.0.42 () {58 vars in 1301 bytes} [Wed May 25 16:25:38 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:25:38.594153 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-fa119da3-4e3e-42c2-a6a4-be8c72618ee9 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:38.595081 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-fa119da3-4e3e-42c2-a6a4-be8c72618ee9 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:38.602752 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-fa119da3-4e3e-42c2-a6a4-be8c72618ee9 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:38.603691 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-fa119da3-4e3e-42c2-a6a4-be8c72618ee9 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:38.606310 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-fa119da3-4e3e-42c2-a6a4-be8c72618ee9 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:38.606846 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-fa119da3-4e3e-42c2-a6a4-be8c72618ee9 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:38.681926 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-fa119da3-4e3e-42c2-a6a4-be8c72618ee9 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:38.689905 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-fa119da3-4e3e-42c2-a6a4-be8c72618ee9 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 200 len: 1605 microversion: 2.1 time: 0.103734 May 25 16:25:38.690480 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 282/569] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:38 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 1605 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:38.701354 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-595cbe69-194c-46cc-bbf7-f579fdcf05ec req-11fbd09b-67c1-494a-9765-1e53f340f091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c525fad-3e59-4bcd-9263-cf3a13d13e3f", "name": "network-vif-deleted", "tag": "5d7ffb26-b14c-4496-a249-7c6754e10040"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:25:38.709292 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-595cbe69-194c-46cc-bbf7-f579fdcf05ec req-11fbd09b-67c1-494a-9765-1e53f340f091 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:38.709748 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-595cbe69-194c-46cc-bbf7-f579fdcf05ec req-11fbd09b-67c1-494a-9765-1e53f340f091 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:38.722853 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-595cbe69-194c-46cc-bbf7-f579fdcf05ec req-11fbd09b-67c1-494a-9765-1e53f340f091 service nova] Creating event network-vif-deleted:5d7ffb26-b14c-4496-a249-7c6754e10040 for instance 9c525fad-3e59-4bcd-9263-cf3a13d13e3f on hv-cinder-84327 May 25 16:25:38.728483 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-595cbe69-194c-46cc-bbf7-f579fdcf05ec req-11fbd09b-67c1-494a-9765-1e53f340f091 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031564 May 25 16:25:38.729466 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 288/570] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:25:39.580513 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-24858e83-9ee3-42c8-8f79-42b12b19219c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:39.581505 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-24858e83-9ee3-42c8-8f79-42b12b19219c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:39.588156 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-24858e83-9ee3-42c8-8f79-42b12b19219c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:39.588595 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-24858e83-9ee3-42c8-8f79-42b12b19219c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:39.589342 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-24858e83-9ee3-42c8-8f79-42b12b19219c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:39.590461 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-24858e83-9ee3-42c8-8f79-42b12b19219c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:39.619988 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-24858e83-9ee3-42c8-8f79-42b12b19219c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043351 May 25 16:25:39.620655 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 283/571] 10.222.0.42 () {58 vars in 1301 bytes} [Wed May 25 16:25:39 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:25:39.803925 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-a4bb08a2-d36e-46d4-a81d-e18373079ac6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:39.804694 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-a4bb08a2-d36e-46d4-a81d-e18373079ac6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:39.811604 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a4bb08a2-d36e-46d4-a81d-e18373079ac6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:39.812038 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a4bb08a2-d36e-46d4-a81d-e18373079ac6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:39.812781 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a4bb08a2-d36e-46d4-a81d-e18373079ac6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:39.813212 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a4bb08a2-d36e-46d4-a81d-e18373079ac6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:39.827347 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.wsgi [None req-a4bb08a2-d36e-46d4-a81d-e18373079ac6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] HTTP exception thrown: Instance 9c525fad-3e59-4bcd-9263-cf3a13d13e3f could not be found. May 25 16:25:39.829037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-a4bb08a2-d36e-46d4-a81d-e18373079ac6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Request method failure captured: May 25 16:25:39.829037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f HTTP/1.1 May 25 16:25:39.829037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:25:39.829037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:25:39.829037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:25:39.829037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 0 May 25 16:25:39.829037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:25:39.829037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:25:39.829037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:25:39.829037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:25:39.829037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijldXnJWiX7WFaRzhSEZJEpgFMy11by1fa61p9fQ2_iYXx_dOqUEpT-Xfhu8XvnV5IAA4PJl4j2v3l07QABoVYuYSBM3EOpnApdVO5VSaVNlYF1RGhdi0o4Y57dwP6pzcSNOaGdIhQeVOY8MKMXsXB0pJHoem7prbNsejF47pgT8V-yg May 25 16:25:39.829037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:25:39.829037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:25:39.829037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:25:39.829037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:25:39.829037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:25:39.829037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:25:39.829037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: 3e8c39550e4e41e79cc56aa7d22ae052 May 25 16:25:39.829037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-AttachVolumeTestJSON-1756534258 May 25 16:25:39.829037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:25:39.829037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:25:39.830625 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e8c39550e4e41e79cc56aa7d22ae052"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3e8c39550e4e41e79cc56aa7d22ae052"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3e8c39550e4e41e79cc56aa7d22ae052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e8c39550e4e41e79cc56aa7d22ae052"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:25:39.830625 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-AttachVolumeTestJSON-1756534258 May 25 16:25:39.830625 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: 3e8c39550e4e41e79cc56aa7d22ae052 May 25 16:25:39.830625 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1756534258 May 25 16:25:39.830625 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-AttachVolumeTestJSON-1756534258-project May 25 16:25:39.830625 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:25:39.830625 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:25:39.830625 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: 15fae427f22d476fa0e378949de41292 May 25 16:25:39.830625 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-AttachVolumeTestJSON-1756534258-project May 25 16:25:39.830625 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: > May 25 16:25:39.830625 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Instance 9c525fad-3e59-4bcd-9263-cf3a13d13e3f could not be found. May 25 16:25:39.830625 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'id': '9c525fad-3e59-4bcd-9263-cf3a13d13e3f'} May 25 16:25:39.831539 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:25:39.831539 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:25:39.831539 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:25:39.831539 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:25:39.831539 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:25:39.831539 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:25:39.831539 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:25:39.831539 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:25:39.831539 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:25:39.831539 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:25:39.831539 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c525fad-3e59-4bcd-9263-cf3a13d13e3f could not be found. May 25 16:25:39.831539 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:25:39.831539 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:25:39.831539 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:25:39.831539 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:25:39.831539 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:25:39.831539 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:25:39.831539 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:25:39.831539 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:25:39.831539 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:25:39.833082 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:25:39.833082 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:25:39.833082 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:25:39.833082 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:25:39.833082 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:25:39.833082 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:25:39.833082 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:25:39.833082 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c525fad-3e59-4bcd-9263-cf3a13d13e3f could not be found. May 25 16:25:39.833082 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:25:39.833082 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:25:39.833082 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:25:39.833082 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:25:39.833082 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:25:39.833082 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:25:39.833082 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:25:39.833082 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:25:39.833082 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c525fad-3e59-4bcd-9263-cf3a13d13e3f could not be found. May 25 16:25:39.833082 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:25:39.834493 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-a4bb08a2-d36e-46d4-a81d-e18373079ac6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Returning 404 to user: Instance 9c525fad-3e59-4bcd-9263-cf3a13d13e3f could not be found. {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:25:39.834493 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-a4bb08a2-d36e-46d4-a81d-e18373079ac6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 404 len: 111 microversion: 2.1 time: 0.127113 May 25 16:25:39.834493 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 289/572] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:39 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:25:39.839157 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-bf958938-6c0a-417d-97b8-a56e0ef49c0e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '.version_select at 0x7f51eda7f3a0>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:39.856419 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-bf958938-6c0a-417d-97b8-a56e0ef49c0e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-128269002" status: 202 len: 0 microversion: 2.1 time: 0.020887 May 25 16:25:39.857011 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 284/573] 10.222.0.42 () {58 vars in 1217 bytes} [Wed May 25 16:25:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-128269002 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 16:25:40.015094 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-94e8713e-3b0f-4abb-a448-683280a4989c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:40.020642 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-94e8713e-3b0f-4abb-a448-683280a4989c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:40.026766 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-94e8713e-3b0f-4abb-a448-683280a4989c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:40.027267 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-94e8713e-3b0f-4abb-a448-683280a4989c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:40.028041 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-94e8713e-3b0f-4abb-a448-683280a4989c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:40.028431 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-94e8713e-3b0f-4abb-a448-683280a4989c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:40.060921 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-94e8713e-3b0f-4abb-a448-683280a4989c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] Going to try to terminate instance {{(pid=117509) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:25:40.141000 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-94e8713e-3b0f-4abb-a448-683280a4989c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760" status: 204 len: 0 microversion: 2.1 time: 0.138183 May 25 16:25:40.141586 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 290/574] 10.222.0.42 () {58 vars in 1238 bytes} [Wed May 25 16:25:40 2022] DELETE /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:25:40.150100 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-3d964cdf-0970-47a4-8aca-2c7e1282857b tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:40.150727 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-3d964cdf-0970-47a4-8aca-2c7e1282857b tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:40.157287 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3d964cdf-0970-47a4-8aca-2c7e1282857b tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:40.157766 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3d964cdf-0970-47a4-8aca-2c7e1282857b tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:40.158593 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3d964cdf-0970-47a4-8aca-2c7e1282857b tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:40.159079 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3d964cdf-0970-47a4-8aca-2c7e1282857b tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:40.297612 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-3d964cdf-0970-47a4-8aca-2c7e1282857b tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:40.305351 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-3d964cdf-0970-47a4-8aca-2c7e1282857b tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760" status: 200 len: 1577 microversion: 2.1 time: 0.159128 May 25 16:25:40.306018 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 285/575] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:40 2022] GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:40.507293 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-0695b181-33f8-4587-a9a4-84ee45c43f84 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Action: 'create', calling method: .version_select at 0x7f51ee1c4310>, body: {"keypair": {"name": "tempest-keypair-250809736", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAn14rWdtAtAG28rS5yDfGuLwIGOEYcVqLK9KWxI0k5Ur5D67g2QQlYd0bmrQeB5XorOd3ej4q13DBo+5H/wtmf6TFylknFuyg+FP3rkJAmrI8a8DoyAaITu2MpaiaXhTg=="}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:25:40.522003 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-0695b181-33f8-4587-a9a4-84ee45c43f84 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Getting quotas for project 3e8c39550e4e41e79cc56aa7d22ae052. Resources: {'key_pairs'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:25:40.525798 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-0695b181-33f8-4587-a9a4-84ee45c43f84 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Getting quotas for user 15fae427f22d476fa0e378949de41292 and project 3e8c39550e4e41e79cc56aa7d22ae052. Resources: {'key_pairs'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:25:40.547800 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-0695b181-33f8-4587-a9a4-84ee45c43f84 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044749 May 25 16:25:40.548427 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 291/576] 10.222.0.42 () {60 vars in 1158 bytes} [Wed May 25 16:25:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:25:40.632609 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-81b9755a-9afa-4f79-9ec1-900e6c96c7b0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:40.633660 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-81b9755a-9afa-4f79-9ec1-900e6c96c7b0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:40.640797 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-81b9755a-9afa-4f79-9ec1-900e6c96c7b0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:40.641320 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-81b9755a-9afa-4f79-9ec1-900e6c96c7b0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:40.642206 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-81b9755a-9afa-4f79-9ec1-900e6c96c7b0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:40.642714 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-81b9755a-9afa-4f79-9ec1-900e6c96c7b0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:40.673433 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-81b9755a-9afa-4f79-9ec1-900e6c96c7b0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044719 May 25 16:25:40.674479 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 286/577] 10.222.0.42 () {58 vars in 1301 bytes} [Wed May 25 16:25:40 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:25:41.324445 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-1b1cf220-7ac1-4441-ada3-eef5efcaf106 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:41.326060 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-1b1cf220-7ac1-4441-ada3-eef5efcaf106 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:41.333006 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1b1cf220-7ac1-4441-ada3-eef5efcaf106 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:41.333443 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1b1cf220-7ac1-4441-ada3-eef5efcaf106 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:41.334228 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1b1cf220-7ac1-4441-ada3-eef5efcaf106 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:41.334656 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1b1cf220-7ac1-4441-ada3-eef5efcaf106 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:41.523996 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-1b1cf220-7ac1-4441-ada3-eef5efcaf106 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:41.531822 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-1b1cf220-7ac1-4441-ada3-eef5efcaf106 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760" status: 200 len: 1577 microversion: 2.1 time: 0.211931 May 25 16:25:41.532394 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 292/578] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:41 2022] GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 => generated 1577 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:41.741541 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-d2fa5fb1-d2ff-49c2-b52b-5c48eddc3ab4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:41.742494 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-d2fa5fb1-d2ff-49c2-b52b-5c48eddc3ab4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:41.749183 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d2fa5fb1-d2ff-49c2-b52b-5c48eddc3ab4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:41.749636 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d2fa5fb1-d2ff-49c2-b52b-5c48eddc3ab4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:41.750444 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d2fa5fb1-d2ff-49c2-b52b-5c48eddc3ab4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:41.750886 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d2fa5fb1-d2ff-49c2-b52b-5c48eddc3ab4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:41.785390 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-d2fa5fb1-d2ff-49c2-b52b-5c48eddc3ab4 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103606 May 25 16:25:41.786204 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 287/579] 10.222.0.42 () {58 vars in 1301 bytes} [Wed May 25 16:25:41 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:25:41.863177 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-70e2b734-7eeb-4d5e-96eb-6392eaa0de2b tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1568284026", "imageRef": "e74cccc1-cd1b-4dfc-8e47-3e4a832649a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c47b68ec-cf9c-457c-8d2b-ef3d80fa25c9"}], "security_groups": [{"name": "tempest-securitygroup--641454221"}], "key_name": "tempest-keypair-250809736", "user_data": "}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:25:41.963160 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.network.neutron [None req-70e2b734-7eeb-4d5e-96eb-6392eaa0de2b tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] validate_networks() for [('c47b68ec-cf9c-457c-8d2b-ef3d80fa25c9', None, None, None, None, None)] {{(pid=117509) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:25:42.372900 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-70e2b734-7eeb-4d5e-96eb-6392eaa0de2b tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Flavor limits 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:25:42.373472 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-70e2b734-7eeb-4d5e-96eb-6392eaa0de2b tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Image limits 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:25:42.373791 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-70e2b734-7eeb-4d5e-96eb-6392eaa0de2b tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Flavor pref 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:25:42.374226 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-70e2b734-7eeb-4d5e-96eb-6392eaa0de2b tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Image pref 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:25:42.374632 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-70e2b734-7eeb-4d5e-96eb-6392eaa0de2b tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:25:42.383468 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-70e2b734-7eeb-4d5e-96eb-6392eaa0de2b tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:42.383902 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-70e2b734-7eeb-4d5e-96eb-6392eaa0de2b tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:42.384690 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-70e2b734-7eeb-4d5e-96eb-6392eaa0de2b tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:42.385128 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-70e2b734-7eeb-4d5e-96eb-6392eaa0de2b tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:42.401929 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-70e2b734-7eeb-4d5e-96eb-6392eaa0de2b tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Getting quotas for project 3e8c39550e4e41e79cc56aa7d22ae052. Resources: {'ram', 'cores', 'instances'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:25:42.406204 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-70e2b734-7eeb-4d5e-96eb-6392eaa0de2b tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Getting quotas for user 15fae427f22d476fa0e378949de41292 and project 3e8c39550e4e41e79cc56aa7d22ae052. Resources: {'ram', 'cores', 'instances'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:25:42.417355 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-70e2b734-7eeb-4d5e-96eb-6392eaa0de2b tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Going to run 1 instances... {{(pid=117509) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:25:42.420212 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-70e2b734-7eeb-4d5e-96eb-6392eaa0de2b tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e74cccc1-cd1b-4dfc-8e47-3e4a832649a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:25:42.472015 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-70e2b734-7eeb-4d5e-96eb-6392eaa0de2b tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.612904 May 25 16:25:42.472831 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 293/580] 10.222.0.42 () {60 vars in 1146 bytes} [Wed May 25 16:25:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:25:42.484236 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-d88f8970-1b9a-4451-81f2-96e93f51eed2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:42.484866 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-d88f8970-1b9a-4451-81f2-96e93f51eed2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:42.540777 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-d88f8970-1b9a-4451-81f2-96e93f51eed2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:42.548737 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-d88f8970-1b9a-4451-81f2-96e93f51eed2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44" status: 200 len: 1237 microversion: 2.1 time: 0.069809 May 25 16:25:42.549450 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 288/581] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:42 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:42.559344 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-e6107249-1745-4680-a932-054f3fce8af0 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:42.560037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-e6107249-1745-4680-a932-054f3fce8af0 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:42.569610 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e6107249-1745-4680-a932-054f3fce8af0 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:42.570091 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e6107249-1745-4680-a932-054f3fce8af0 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:42.571118 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e6107249-1745-4680-a932-054f3fce8af0 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:42.571632 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e6107249-1745-4680-a932-054f3fce8af0 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:42.732634 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-e6107249-1745-4680-a932-054f3fce8af0 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:42.740433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-e6107249-1745-4680-a932-054f3fce8af0 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760" status: 200 len: 1577 microversion: 2.1 time: 0.194778 May 25 16:25:42.741315 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 294/582] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:42 2022] GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 => generated 1577 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:42.798018 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-da4a4740-0dd6-4215-936e-e344dd270f69 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:42.800712 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-da4a4740-0dd6-4215-936e-e344dd270f69 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:42.808903 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-da4a4740-0dd6-4215-936e-e344dd270f69 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:42.810349 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-da4a4740-0dd6-4215-936e-e344dd270f69 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:42.811378 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-da4a4740-0dd6-4215-936e-e344dd270f69 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:42.811971 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-da4a4740-0dd6-4215-936e-e344dd270f69 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:42.849113 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-da4a4740-0dd6-4215-936e-e344dd270f69 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055210 May 25 16:25:42.850128 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 289/583] 10.222.0.42 () {58 vars in 1301 bytes} [Wed May 25 16:25:42 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:25:42.986986 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-ef9092f7-56af-40bf-8117-a24858ba3a50 req-7c59db56-50e7-4158-be34-ca6d46b56bec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2ffa3b0-9de0-483c-86b7-0f18718d8760", "name": "network-vif-deleted", "tag": "b584eb77-9528-491e-9943-03658d935cdc"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:25:43.007209 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-ef9092f7-56af-40bf-8117-a24858ba3a50 req-7c59db56-50e7-4158-be34-ca6d46b56bec service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:43.007853 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-ef9092f7-56af-40bf-8117-a24858ba3a50 req-7c59db56-50e7-4158-be34-ca6d46b56bec service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:43.024687 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-ef9092f7-56af-40bf-8117-a24858ba3a50 req-7c59db56-50e7-4158-be34-ca6d46b56bec service nova] Creating event network-vif-deleted:b584eb77-9528-491e-9943-03658d935cdc for instance c2ffa3b0-9de0-483c-86b7-0f18718d8760 on hv-cinder-84327 May 25 16:25:43.032409 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-ef9092f7-56af-40bf-8117-a24858ba3a50 req-7c59db56-50e7-4158-be34-ca6d46b56bec service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060402 May 25 16:25:43.034284 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 295/584] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:25:43.566227 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-719c308e-3313-4a56-9a67-528e82574d91 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:43.566968 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-719c308e-3313-4a56-9a67-528e82574d91 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:43.572923 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-719c308e-3313-4a56-9a67-528e82574d91 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:43.573448 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-719c308e-3313-4a56-9a67-528e82574d91 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:43.574897 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-719c308e-3313-4a56-9a67-528e82574d91 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:43.575338 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-719c308e-3313-4a56-9a67-528e82574d91 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:43.639194 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-719c308e-3313-4a56-9a67-528e82574d91 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:43.646594 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-719c308e-3313-4a56-9a67-528e82574d91 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44" status: 200 len: 1289 microversion: 2.1 time: 0.084200 May 25 16:25:43.647151 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 290/585] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:43 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44 => generated 1289 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:43.758275 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-7b137d8d-5d60-4174-b78b-b764ee6d0856 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:43.759036 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-7b137d8d-5d60-4174-b78b-b764ee6d0856 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:43.766037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7b137d8d-5d60-4174-b78b-b764ee6d0856 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:43.766580 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7b137d8d-5d60-4174-b78b-b764ee6d0856 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:43.767412 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7b137d8d-5d60-4174-b78b-b764ee6d0856 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:43.767910 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7b137d8d-5d60-4174-b78b-b764ee6d0856 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:43.803267 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7b137d8d-5d60-4174-b78b-b764ee6d0856 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:43.803714 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7b137d8d-5d60-4174-b78b-b764ee6d0856 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:43.804161 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.objects.instance [None req-7b137d8d-5d60-4174-b78b-b764ee6d0856 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lazy-loading 'fault' on Instance uuid c2ffa3b0-9de0-483c-86b7-0f18718d8760 {{(pid=117509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:25:43.848227 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-7b137d8d-5d60-4174-b78b-b764ee6d0856 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:43.857628 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-7b137d8d-5d60-4174-b78b-b764ee6d0856 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760" status: 200 len: 1231 microversion: 2.1 time: 0.103538 May 25 16:25:43.858338 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 296/586] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:43 2022] GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 => generated 1231 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:43.867148 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-7dfcb165-e0ac-48bf-8fb8-b884c18a0501 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:43.867148 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-7dfcb165-e0ac-48bf-8fb8-b884c18a0501 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:43.868753 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7dfcb165-e0ac-48bf-8fb8-b884c18a0501 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:43.869199 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7dfcb165-e0ac-48bf-8fb8-b884c18a0501 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:43.870003 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7dfcb165-e0ac-48bf-8fb8-b884c18a0501 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:43.870452 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7dfcb165-e0ac-48bf-8fb8-b884c18a0501 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:43.903309 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-7dfcb165-e0ac-48bf-8fb8-b884c18a0501 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046005 May 25 16:25:43.903902 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 291/587] 10.222.0.42 () {58 vars in 1301 bytes} [Wed May 25 16:25:43 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:25:44.664144 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-9e661ddb-eadc-4058-8d32-75bf233bd41c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:44.664672 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-9e661ddb-eadc-4058-8d32-75bf233bd41c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:44.670868 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9e661ddb-eadc-4058-8d32-75bf233bd41c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:44.671312 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9e661ddb-eadc-4058-8d32-75bf233bd41c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:44.672067 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9e661ddb-eadc-4058-8d32-75bf233bd41c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:44.672500 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9e661ddb-eadc-4058-8d32-75bf233bd41c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:44.735879 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-9e661ddb-eadc-4058-8d32-75bf233bd41c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:44.743239 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-9e661ddb-eadc-4058-8d32-75bf233bd41c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44" status: 200 len: 1295 microversion: 2.1 time: 0.083324 May 25 16:25:44.743795 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 297/588] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:44 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44 => generated 1295 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:44.874610 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-a9154983-1971-4a92-a05e-33af1b669d5e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:44.875230 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-a9154983-1971-4a92-a05e-33af1b669d5e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:44.881776 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a9154983-1971-4a92-a05e-33af1b669d5e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:44.882233 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a9154983-1971-4a92-a05e-33af1b669d5e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:44.883002 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a9154983-1971-4a92-a05e-33af1b669d5e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:44.883448 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a9154983-1971-4a92-a05e-33af1b669d5e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:44.901648 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.wsgi [None req-a9154983-1971-4a92-a05e-33af1b669d5e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] HTTP exception thrown: Instance c2ffa3b0-9de0-483c-86b7-0f18718d8760 could not be found. May 25 16:25:44.903726 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-a9154983-1971-4a92-a05e-33af1b669d5e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Request method failure captured: May 25 16:25:44.903726 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: request: GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 HTTP/1.1 May 25 16:25:44.903726 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept: application/json May 25 16:25:44.903726 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept-Encoding: identity May 25 16:25:44.903726 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Connection: close May 25 16:25:44.903726 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Length: 0 May 25 16:25:44.903726 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Type: application/json May 25 16:25:44.903726 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Host: 10.222.0.42 May 25 16:25:44.903726 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Openstack-System-Scope: None May 25 16:25:44.903726 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: User-Agent: python-urllib3/1.26.9 May 25 16:25:44.903726 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Auth-Token: gAAAAABijlelzdsMf1DE_OJe4dAbolblNKTr5NJvI-0q9wR4ptTmYRXo7rIjfLWlJ8nvNyeHfiuhnvR9gWqRK6NHlHVGZOOk2Ahu15RsMbq4KZCpetI0YLeLWc9IC0N_3ktKyFVJ0plPOQzLQb0HgErkzSh6xF6AXOk6u3gHvA9r-zcV9P757SM May 25 16:25:44.903726 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Id: None May 25 16:25:44.903726 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Name: None May 25 16:25:44.903726 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Identity-Status: Confirmed May 25 16:25:44.903726 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Is-Admin-Project: True May 25 16:25:44.903726 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Id: default May 25 16:25:44.903726 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Name: Default May 25 16:25:44.903726 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Id: a40431f830294ea0a6395be072560dea May 25 16:25:44.903726 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Name: tempest-TestVolumeBootPattern-617412873 May 25 16:25:44.903726 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Role: reader,member May 25 16:25:44.903726 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Roles: reader,member May 25 16:25:44.905439 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a40431f830294ea0a6395be072560dea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a40431f830294ea0a6395be072560dea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a40431f830294ea0a6395be072560dea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a40431f830294ea0a6395be072560dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:25:44.905439 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant: tempest-TestVolumeBootPattern-617412873 May 25 16:25:44.905439 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Id: a40431f830294ea0a6395be072560dea May 25 16:25:44.905439 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Name: tempest-TestVolumeBootPattern-617412873 May 25 16:25:44.905439 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User: tempest-TestVolumeBootPattern-617412873-project May 25 16:25:44.905439 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Id: default May 25 16:25:44.905439 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Name: Default May 25 16:25:44.905439 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Id: c935f035c757482ca912a8c4b77714a0 May 25 16:25:44.905439 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Name: tempest-TestVolumeBootPattern-617412873-project May 25 16:25:44.905439 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: method: > May 25 16:25:44.905439 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: exception: Instance c2ffa3b0-9de0-483c-86b7-0f18718d8760 could not be found. May 25 16:25:44.905439 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: action_args: {'id': 'c2ffa3b0-9de0-483c-86b7-0f18718d8760'} May 25 16:25:44.906350 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:25:44.906350 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:25:44.906350 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:25:44.906350 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:25:44.906350 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:25:44.906350 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:25:44.906350 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:25:44.906350 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:25:44.906350 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:25:44.906350 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:25:44.906350 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2ffa3b0-9de0-483c-86b7-0f18718d8760 could not be found. May 25 16:25:44.906350 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:25:44.906350 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:25:44.906350 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:25:44.906350 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:25:44.906350 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:25:44.906350 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:25:44.906350 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:25:44.906350 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:25:44.906350 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:25:44.907742 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:25:44.907742 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:25:44.907742 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:25:44.907742 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:25:44.907742 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:25:44.907742 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:25:44.907742 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:25:44.907742 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2ffa3b0-9de0-483c-86b7-0f18718d8760 could not be found. May 25 16:25:44.907742 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:25:44.907742 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:25:44.907742 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:25:44.907742 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:25:44.907742 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:25:44.907742 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:25:44.907742 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:25:44.907742 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:25:44.907742 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2ffa3b0-9de0-483c-86b7-0f18718d8760 could not be found. May 25 16:25:44.907742 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:25:44.908972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-a9154983-1971-4a92-a05e-33af1b669d5e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Returning 404 to user: Instance c2ffa3b0-9de0-483c-86b7-0f18718d8760 could not be found. {{(pid=117510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:25:44.908972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-a9154983-1971-4a92-a05e-33af1b669d5e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760" status: 404 len: 111 microversion: 2.1 time: 0.034945 May 25 16:25:44.908972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 292/589] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:44 2022] GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:25:44.919777 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-9b5abbcf-c636-4418-a63f-f3a1fd27481a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:44.920852 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-9b5abbcf-c636-4418-a63f-f3a1fd27481a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:44.926866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9b5abbcf-c636-4418-a63f-f3a1fd27481a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:44.927304 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9b5abbcf-c636-4418-a63f-f3a1fd27481a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:44.928054 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9b5abbcf-c636-4418-a63f-f3a1fd27481a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:44.928479 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9b5abbcf-c636-4418-a63f-f3a1fd27481a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:44.968909 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-9b5abbcf-c636-4418-a63f-f3a1fd27481a tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053824 May 25 16:25:44.970351 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 298/590] 10.222.0.42 () {58 vars in 1301 bytes} [Wed May 25 16:25:44 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:25:45.032047 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-97f014e0-1629-419b-9829-66388596a03c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-333830373", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1857624386", "security_groups": [{"name": "tempest-secgroup-smoke-1860376157"}], "block_device_mapping_v2": [{"uuid": "0343a3ee-5c04-4a99-9c60-ed1f3cb80073", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5f7c259b-fa42-4f62-9149-4145e768ec9c"}]}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:25:45.151870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.network.neutron [None req-97f014e0-1629-419b-9829-66388596a03c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] validate_networks() for [('5f7c259b-fa42-4f62-9149-4145e768ec9c', None, None, None, None, None)] {{(pid=117510) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:25:45.606067 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-97f014e0-1629-419b-9829-66388596a03c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Flavor limits 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:25:45.606492 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-97f014e0-1629-419b-9829-66388596a03c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Image limits 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:25:45.606962 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-97f014e0-1629-419b-9829-66388596a03c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Flavor pref 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:25:45.607370 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-97f014e0-1629-419b-9829-66388596a03c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Image pref 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:25:45.607777 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-97f014e0-1629-419b-9829-66388596a03c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:25:45.617969 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-97f014e0-1629-419b-9829-66388596a03c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:45.618583 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-97f014e0-1629-419b-9829-66388596a03c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:45.619387 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-97f014e0-1629-419b-9829-66388596a03c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:45.619829 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-97f014e0-1629-419b-9829-66388596a03c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:45.638803 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-97f014e0-1629-419b-9829-66388596a03c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Getting quotas for project a40431f830294ea0a6395be072560dea. Resources: {'ram', 'cores', 'instances'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:25:45.642820 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-97f014e0-1629-419b-9829-66388596a03c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Getting quotas for user c935f035c757482ca912a8c4b77714a0 and project a40431f830294ea0a6395be072560dea. Resources: {'ram', 'cores', 'instances'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:25:45.710203 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-97f014e0-1629-419b-9829-66388596a03c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Going to run 1 instances... {{(pid=117510) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:25:45.712735 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-97f014e0-1629-419b-9829-66388596a03c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0343a3ee-5c04-4a99-9c60-ed1f3cb80073',volume_size=None,volume_type=None)] {{(pid=117510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:25:45.762924 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-3f8f4a02-a459-4c98-980f-160449c705b1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:45.764611 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-3f8f4a02-a459-4c98-980f-160449c705b1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:45.778060 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3f8f4a02-a459-4c98-980f-160449c705b1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:45.778816 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3f8f4a02-a459-4c98-980f-160449c705b1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:45.779709 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3f8f4a02-a459-4c98-980f-160449c705b1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:45.780367 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3f8f4a02-a459-4c98-980f-160449c705b1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:45.896527 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-97f014e0-1629-419b-9829-66388596a03c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.869531 May 25 16:25:45.897269 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 293/591] 10.222.0.42 () {60 vars in 1146 bytes} [Wed May 25 16:25:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:25:45.909614 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-4933b7d7-c1ba-468b-81ea-b182ed542fd6 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:45.939572 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-4933b7d7-c1ba-468b-81ea-b182ed542fd6 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:45.955417 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-3f8f4a02-a459-4c98-980f-160449c705b1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:45.966643 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-3f8f4a02-a459-4c98-980f-160449c705b1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44" status: 200 len: 1362 microversion: 2.1 time: 0.209911 May 25 16:25:45.967773 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 299/592] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:45 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:45.981119 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-1e6802ba-1fd3-44fa-b824-5ecd06d2f397 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:45.982076 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-1e6802ba-1fd3-44fa-b824-5ecd06d2f397 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:46.003559 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1e6802ba-1fd3-44fa-b824-5ecd06d2f397 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:46.004317 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1e6802ba-1fd3-44fa-b824-5ecd06d2f397 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:46.005520 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1e6802ba-1fd3-44fa-b824-5ecd06d2f397 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:46.006402 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1e6802ba-1fd3-44fa-b824-5ecd06d2f397 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:46.022424 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-4933b7d7-c1ba-468b-81ea-b182ed542fd6 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:46.034656 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-4933b7d7-c1ba-468b-81ea-b182ed542fd6 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c" status: 200 len: 1094 microversion: 2.1 time: 0.130613 May 25 16:25:46.035241 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 294/593] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:45 2022] GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c => generated 1094 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:46.044014 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-1e6802ba-1fd3-44fa-b824-5ecd06d2f397 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067285 May 25 16:25:46.049246 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 300/594] 10.222.0.42 () {58 vars in 1301 bytes} [Wed May 25 16:25:45 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 16:25:46.141046 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-5c94107a-d34f-44ea-a523-5418521fdbaa tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:46.141617 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-5c94107a-d34f-44ea-a523-5418521fdbaa tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:46.148936 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5c94107a-d34f-44ea-a523-5418521fdbaa tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:46.149439 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5c94107a-d34f-44ea-a523-5418521fdbaa tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:46.150716 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5c94107a-d34f-44ea-a523-5418521fdbaa tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:46.151568 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5c94107a-d34f-44ea-a523-5418521fdbaa tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:46.156804 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:25:46.188304 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-1a59d2c3-9a68-4c8f-b33a-d47852c254a3 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3bbecd9-0b4a-462d-bff8-41757c8279cf"}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:25:46.189485 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-1a59d2c3-9a68-4c8f-b33a-d47852c254a3 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:46.190831 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-5c94107a-d34f-44ea-a523-5418521fdbaa tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Going to try to terminate instance {{(pid=117510) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:25:46.196938 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1a59d2c3-9a68-4c8f-b33a-d47852c254a3 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:46.197429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1a59d2c3-9a68-4c8f-b33a-d47852c254a3 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:46.199199 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1a59d2c3-9a68-4c8f-b33a-d47852c254a3 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:46.200177 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1a59d2c3-9a68-4c8f-b33a-d47852c254a3 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:46.221888 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:25:46.296938 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-5c94107a-d34f-44ea-a523-5418521fdbaa tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 204 len: 0 microversion: 2.1 time: 0.160769 May 25 16:25:46.301401 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 295/595] 10.222.0.42 () {58 vars in 1238 bytes} [Wed May 25 16:25:46 2022] DELETE /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:25:46.309352 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-4bb6ea03-c7cc-4336-9077-954c0220e44e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:46.310310 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-4bb6ea03-c7cc-4336-9077-954c0220e44e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:46.317918 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4bb6ea03-c7cc-4336-9077-954c0220e44e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:46.318632 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4bb6ea03-c7cc-4336-9077-954c0220e44e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:46.319579 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4bb6ea03-c7cc-4336-9077-954c0220e44e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:46.320796 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4bb6ea03-c7cc-4336-9077-954c0220e44e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:46.340324 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.wsgi [None req-1a59d2c3-9a68-4c8f-b33a-d47852c254a3 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] HTTP exception thrown: Invalid volume: volume f3bbecd9-0b4a-462d-bff8-41757c8279cf is already attached to instances: 125fb239-87ee-4665-94f5-252ee52d73af May 25 16:25:46.342288 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-1a59d2c3-9a68-4c8f-b33a-d47852c254a3 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Request method failure captured: May 25 16:25:46.342288 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: POST /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af/os-volume_attachments HTTP/1.1 May 25 16:25:46.342288 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:25:46.342288 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:25:46.342288 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:25:46.342288 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 74 May 25 16:25:46.342288 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:25:46.342288 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:25:46.342288 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:25:46.342288 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:25:46.342288 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijldM9TsAZJy8dFB1DMOmN3fYD4FVUv3HZ7K9WxI11fcxXnHOFEKVQuqoz4pXUAyb9YMnHusiEz5_9NIfv66CxCRP6OYrV0TQFouqehYLNaYvAb5OzaoSF8oLgazxJMBBuxROCk5D-B6RTnZ7yadTSJVodvBMZSALenmgyavmYCv9RJ0 May 25 16:25:46.342288 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:25:46.342288 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:25:46.342288 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:25:46.342288 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:25:46.342288 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:25:46.342288 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:25:46.342288 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: 9d234edace28441282f594f0e03cacc5 May 25 16:25:46.342288 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:25:46.342288 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:25:46.342288 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:25:46.343702 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d234edace28441282f594f0e03cacc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d234edace28441282f594f0e03cacc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d234edace28441282f594f0e03cacc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d234edace28441282f594f0e03cacc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:25:46.343702 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:25:46.343702 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: 9d234edace28441282f594f0e03cacc5 May 25 16:25:46.343702 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:25:46.343702 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-AttachVolumeNegativeTest-1719621589-project May 25 16:25:46.343702 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:25:46.343702 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:25:46.343702 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: b781c4c6cb61439fb781988a7da028ff May 25 16:25:46.343702 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-AttachVolumeNegativeTest-1719621589-project May 25 16:25:46.343702 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: May 25 16:25:46.343702 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {"volumeAttachment": {"volumeId": "f3bbecd9-0b4a-462d-bff8-41757c8279cf"}} May 25 16:25:46.343702 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: > May 25 16:25:46.344560 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Invalid volume: volume f3bbecd9-0b4a-462d-bff8-41757c8279cf is already attached to instances: 125fb239-87ee-4665-94f5-252ee52d73af May 25 16:25:46.344560 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'server_id': '125fb239-87ee-4665-94f5-252ee52d73af', 'body': {'volumeAttachment': {'volumeId': 'f3bbecd9-0b4a-462d-bff8-41757c8279cf'}}} May 25 16:25:46.344560 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:25:46.344560 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:25:46.344560 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 25 16:25:46.344560 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 25 16:25:46.344560 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 25 16:25:46.344560 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 25 16:25:46.344560 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 25 16:25:46.344560 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 25 16:25:46.344560 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 25 16:25:46.344560 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 25 16:25:46.344560 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 25 16:25:46.344560 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 25 16:25:46.344560 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f3bbecd9-0b4a-462d-bff8-41757c8279cf is already attached to instances: 125fb239-87ee-4665-94f5-252ee52d73af May 25 16:25:46.344560 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:25:46.344560 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:25:46.344560 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:25:46.344560 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:25:46.345750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:25:46.345750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:25:46.345750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:25:46.345750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:25:46.345750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:25:46.345750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:25:46.345750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 16:25:46.345750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 16:25:46.345750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 16:25:46.345750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 16:25:46.345750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 16:25:46.345750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 16:25:46.345750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 25 16:25:46.345750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 25 16:25:46.345750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f3bbecd9-0b4a-462d-bff8-41757c8279cf is already attached to instances: 125fb239-87ee-4665-94f5-252ee52d73af May 25 16:25:46.345750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:25:46.345750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:25:46.345750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:25:46.345750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:25:46.345750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:25:46.347044 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:25:46.347044 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:25:46.347044 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:25:46.347044 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f3bbecd9-0b4a-462d-bff8-41757c8279cf is already attached to instances: 125fb239-87ee-4665-94f5-252ee52d73af May 25 16:25:46.347044 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:25:46.350668 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-1a59d2c3-9a68-4c8f-b33a-d47852c254a3 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Returning 400 to user: Invalid volume: volume f3bbecd9-0b4a-462d-bff8-41757c8279cf is already attached to instances: 125fb239-87ee-4665-94f5-252ee52d73af {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:25:46.352439 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-1a59d2c3-9a68-4c8f-b33a-d47852c254a3 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "POST /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.168169 May 25 16:25:46.353564 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 301/596] 10.222.0.42 () {60 vars in 1322 bytes} [Wed May 25 16:25:46 2022] POST /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af/os-volume_attachments => generated 174 bytes in 170 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 25 16:25:46.444394 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-ea699433-f644-4b9b-be21-4a48202566c1 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:46.445616 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-ea699433-f644-4b9b-be21-4a48202566c1 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:46.453287 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ea699433-f644-4b9b-be21-4a48202566c1 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:46.453752 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ea699433-f644-4b9b-be21-4a48202566c1 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:46.454537 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ea699433-f644-4b9b-be21-4a48202566c1 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:46.454963 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ea699433-f644-4b9b-be21-4a48202566c1 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:46.509372 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-4bb6ea03-c7cc-4336-9077-954c0220e44e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:46.522575 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-4bb6ea03-c7cc-4336-9077-954c0220e44e tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1687 microversion: 2.1 time: 0.217707 May 25 16:25:46.535424 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 296/597] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:46 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1687 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:46.556789 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.objects.instance [None req-ea699433-f644-4b9b-be21-4a48202566c1 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lazy-loading 'services' on Instance uuid 125fb239-87ee-4665-94f5-252ee52d73af {{(pid=117509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:25:46.643964 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-ea699433-f644-4b9b-be21-4a48202566c1 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "DELETE /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af/os-volume_attachments/f3bbecd9-0b4a-462d-bff8-41757c8279cf" status: 202 len: 0 microversion: 2.1 time: 0.207408 May 25 16:25:46.644846 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 302/598] 10.222.0.42 () {58 vars in 1415 bytes} [Wed May 25 16:25:46 2022] DELETE /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af/os-volume_attachments/f3bbecd9-0b4a-462d-bff8-41757c8279cf => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:25:46.654891 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-4c6c8f2c-48db-40bd-a2b5-94f7c96a0001 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:46.656005 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-4c6c8f2c-48db-40bd-a2b5-94f7c96a0001 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:46.662640 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4c6c8f2c-48db-40bd-a2b5-94f7c96a0001 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:46.663083 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4c6c8f2c-48db-40bd-a2b5-94f7c96a0001 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:46.663850 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4c6c8f2c-48db-40bd-a2b5-94f7c96a0001 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:46.664276 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4c6c8f2c-48db-40bd-a2b5-94f7c96a0001 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:46.697790 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-4c6c8f2c-48db-40bd-a2b5-94f7c96a0001 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047817 May 25 16:25:46.698361 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 297/599] 10.222.0.42 () {58 vars in 1301 bytes} [Wed May 25 16:25:46 2022] GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:25:46.770309 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-a65fe95c-d650-469f-97ef-e25f704f543a req-dd9881eb-7851-4ce0-acfb-c007fee8fd3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50c1e1a5-ce7f-4032-b028-431051dfde44", "tag": "a3612e40-f8ea-4391-b684-977f3fa2cfff"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:25:46.779410 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-a65fe95c-d650-469f-97ef-e25f704f543a req-dd9881eb-7851-4ce0-acfb-c007fee8fd3b service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:46.779852 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-a65fe95c-d650-469f-97ef-e25f704f543a req-dd9881eb-7851-4ce0-acfb-c007fee8fd3b service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:46.795508 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-a65fe95c-d650-469f-97ef-e25f704f543a req-dd9881eb-7851-4ce0-acfb-c007fee8fd3b service nova] Creating event network-changed:a3612e40-f8ea-4391-b684-977f3fa2cfff for instance 50c1e1a5-ce7f-4032-b028-431051dfde44 on hv-cinder-84327 May 25 16:25:46.801591 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-a65fe95c-d650-469f-97ef-e25f704f543a req-dd9881eb-7851-4ce0-acfb-c007fee8fd3b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035331 May 25 16:25:46.802624 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 303/600] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:25:46.983642 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-cb69217a-7cd0-477b-959f-521f31291fe2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:46.984268 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-cb69217a-7cd0-477b-959f-521f31291fe2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:46.990718 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-cb69217a-7cd0-477b-959f-521f31291fe2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:46.991161 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-cb69217a-7cd0-477b-959f-521f31291fe2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:46.991909 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-cb69217a-7cd0-477b-959f-521f31291fe2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:46.992339 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-cb69217a-7cd0-477b-959f-521f31291fe2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:47.052884 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-36b5f228-2348-42ad-bf94-30e6cf330b1d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:47.053580 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-36b5f228-2348-42ad-bf94-30e6cf330b1d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:47.061011 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-36b5f228-2348-42ad-bf94-30e6cf330b1d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:47.061455 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-36b5f228-2348-42ad-bf94-30e6cf330b1d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:47.062368 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-36b5f228-2348-42ad-bf94-30e6cf330b1d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:47.062807 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-36b5f228-2348-42ad-bf94-30e6cf330b1d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:47.132480 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-36b5f228-2348-42ad-bf94-30e6cf330b1d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:47.140576 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-36b5f228-2348-42ad-bf94-30e6cf330b1d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c" status: 200 len: 1144 microversion: 2.1 time: 0.091835 May 25 16:25:47.141141 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 304/601] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:47 2022] GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:25:47.149133 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-cb69217a-7cd0-477b-959f-521f31291fe2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:47.157002 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-cb69217a-7cd0-477b-959f-521f31291fe2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44" status: 200 len: 1362 microversion: 2.1 time: 0.177469 May 25 16:25:47.157552 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 298/602] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:46 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:47.541904 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-b0605829-4d01-4425-9afd-8c00a1637292 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:47.543218 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-b0605829-4d01-4425-9afd-8c00a1637292 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:47.549321 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b0605829-4d01-4425-9afd-8c00a1637292 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:47.549791 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b0605829-4d01-4425-9afd-8c00a1637292 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:47.550537 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b0605829-4d01-4425-9afd-8c00a1637292 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:47.550961 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b0605829-4d01-4425-9afd-8c00a1637292 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:47.685745 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-b0605829-4d01-4425-9afd-8c00a1637292 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:47.693149 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-b0605829-4d01-4425-9afd-8c00a1637292 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1687 microversion: 2.1 time: 0.155041 May 25 16:25:47.693651 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 305/603] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:47 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:47.710027 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-ab77662f-d794-4e1a-97e1-13ff7ea530c1 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:47.710938 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-ab77662f-d794-4e1a-97e1-13ff7ea530c1 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:47.717091 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ab77662f-d794-4e1a-97e1-13ff7ea530c1 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:47.717528 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ab77662f-d794-4e1a-97e1-13ff7ea530c1 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:47.718315 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ab77662f-d794-4e1a-97e1-13ff7ea530c1 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:47.718744 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ab77662f-d794-4e1a-97e1-13ff7ea530c1 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:47.748069 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-ab77662f-d794-4e1a-97e1-13ff7ea530c1 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041909 May 25 16:25:47.748604 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 299/604] 10.222.0.42 () {58 vars in 1301 bytes} [Wed May 25 16:25:47 2022] GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:25:48.157648 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-3c8caf4a-4da4-48b9-9563-ebb5c2bb1f02 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:48.158263 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-3c8caf4a-4da4-48b9-9563-ebb5c2bb1f02 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:48.164478 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3c8caf4a-4da4-48b9-9563-ebb5c2bb1f02 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:48.164925 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3c8caf4a-4da4-48b9-9563-ebb5c2bb1f02 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:48.165681 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3c8caf4a-4da4-48b9-9563-ebb5c2bb1f02 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:48.166146 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3c8caf4a-4da4-48b9-9563-ebb5c2bb1f02 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:48.174125 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-96252826-ecf4-4ac8-9625-cb491377c4fe tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:48.174727 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-96252826-ecf4-4ac8-9625-cb491377c4fe tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:48.181233 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-96252826-ecf4-4ac8-9625-cb491377c4fe tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:48.181747 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-96252826-ecf4-4ac8-9625-cb491377c4fe tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:48.182510 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-96252826-ecf4-4ac8-9625-cb491377c4fe tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:48.182945 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-96252826-ecf4-4ac8-9625-cb491377c4fe tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:48.230897 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-3c8caf4a-4da4-48b9-9563-ebb5c2bb1f02 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:48.238728 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-3c8caf4a-4da4-48b9-9563-ebb5c2bb1f02 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c" status: 200 len: 1144 microversion: 2.1 time: 0.084910 May 25 16:25:48.239342 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 306/605] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:48 2022] GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:25:48.323606 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-96252826-ecf4-4ac8-9625-cb491377c4fe tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:48.331693 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-96252826-ecf4-4ac8-9625-cb491377c4fe tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44" status: 200 len: 1362 microversion: 2.1 time: 0.161417 May 25 16:25:48.332250 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 300/606] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:48 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:48.709627 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-ef4d2c44-e0c7-4709-a261-72ee3f735bd1 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:48.710197 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-ef4d2c44-e0c7-4709-a261-72ee3f735bd1 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:48.716367 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ef4d2c44-e0c7-4709-a261-72ee3f735bd1 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:48.716813 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ef4d2c44-e0c7-4709-a261-72ee3f735bd1 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:48.717574 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ef4d2c44-e0c7-4709-a261-72ee3f735bd1 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:48.718037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ef4d2c44-e0c7-4709-a261-72ee3f735bd1 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:48.778378 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-1b28392e-5984-4ca4-b924-2c05a746ec42 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:48.779311 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-1b28392e-5984-4ca4-b924-2c05a746ec42 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:48.785293 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1b28392e-5984-4ca4-b924-2c05a746ec42 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:48.785762 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1b28392e-5984-4ca4-b924-2c05a746ec42 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:48.786516 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1b28392e-5984-4ca4-b924-2c05a746ec42 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:48.787216 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1b28392e-5984-4ca4-b924-2c05a746ec42 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:48.817933 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-1b28392e-5984-4ca4-b924-2c05a746ec42 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062754 May 25 16:25:48.818489 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 301/607] 10.222.0.42 () {58 vars in 1301 bytes} [Wed May 25 16:25:48 2022] GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:25:48.848223 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-ef4d2c44-e0c7-4709-a261-72ee3f735bd1 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:48.855836 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-ef4d2c44-e0c7-4709-a261-72ee3f735bd1 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1687 microversion: 2.1 time: 0.150187 May 25 16:25:48.856469 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 307/608] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:48 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1687 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:49.255461 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-1a9922d1-b48e-4244-9ccb-22bd20b7bcb8 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:49.256109 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-1a9922d1-b48e-4244-9ccb-22bd20b7bcb8 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:49.263030 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1a9922d1-b48e-4244-9ccb-22bd20b7bcb8 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:49.263480 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1a9922d1-b48e-4244-9ccb-22bd20b7bcb8 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:49.264245 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1a9922d1-b48e-4244-9ccb-22bd20b7bcb8 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:49.264681 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1a9922d1-b48e-4244-9ccb-22bd20b7bcb8 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:49.328821 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-1a9922d1-b48e-4244-9ccb-22bd20b7bcb8 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:49.336234 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-1a9922d1-b48e-4244-9ccb-22bd20b7bcb8 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c" status: 200 len: 1144 microversion: 2.1 time: 0.084673 May 25 16:25:49.336793 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 302/609] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:49 2022] GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:49.348210 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-e15ed847-1fb0-4034-a7a6-44494565a6df tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:49.348818 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-e15ed847-1fb0-4034-a7a6-44494565a6df tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:49.355094 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e15ed847-1fb0-4034-a7a6-44494565a6df tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:49.356326 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e15ed847-1fb0-4034-a7a6-44494565a6df tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:49.357088 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e15ed847-1fb0-4034-a7a6-44494565a6df tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:49.357526 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e15ed847-1fb0-4034-a7a6-44494565a6df tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:49.489396 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-e15ed847-1fb0-4034-a7a6-44494565a6df tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:49.497031 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-e15ed847-1fb0-4034-a7a6-44494565a6df tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44" status: 200 len: 1362 microversion: 2.1 time: 0.152619 May 25 16:25:49.497624 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 308/610] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:49 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:49.830364 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-3adb135c-f72a-4f0b-9745-14252f00716d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:49.831506 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-3adb135c-f72a-4f0b-9745-14252f00716d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:49.838033 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3adb135c-f72a-4f0b-9745-14252f00716d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:49.838605 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3adb135c-f72a-4f0b-9745-14252f00716d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:49.839447 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3adb135c-f72a-4f0b-9745-14252f00716d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:49.840807 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3adb135c-f72a-4f0b-9745-14252f00716d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:49.872540 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-82e61cba-895f-4613-b009-df8dd8f1fa72 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:49.880086 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-3adb135c-f72a-4f0b-9745-14252f00716d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053432 May 25 16:25:49.881421 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 303/611] 10.222.0.42 () {58 vars in 1301 bytes} [Wed May 25 16:25:49 2022] GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:25:49.881533 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-82e61cba-895f-4613-b009-df8dd8f1fa72 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:49.890154 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-82e61cba-895f-4613-b009-df8dd8f1fa72 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:49.890826 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-82e61cba-895f-4613-b009-df8dd8f1fa72 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:49.891959 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-82e61cba-895f-4613-b009-df8dd8f1fa72 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:49.893135 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-82e61cba-895f-4613-b009-df8dd8f1fa72 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:50.031218 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-82e61cba-895f-4613-b009-df8dd8f1fa72 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:50.038837 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-82e61cba-895f-4613-b009-df8dd8f1fa72 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1687 microversion: 2.1 time: 0.170244 May 25 16:25:50.039397 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 309/612] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:49 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1687 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:50.360921 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-2f38591c-4036-4ebd-9e35-ec888a857569 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:50.361993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-2f38591c-4036-4ebd-9e35-ec888a857569 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:50.370139 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2f38591c-4036-4ebd-9e35-ec888a857569 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:50.370592 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2f38591c-4036-4ebd-9e35-ec888a857569 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:50.371875 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2f38591c-4036-4ebd-9e35-ec888a857569 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:50.372312 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2f38591c-4036-4ebd-9e35-ec888a857569 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:50.453376 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-2f38591c-4036-4ebd-9e35-ec888a857569 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:50.462373 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-2f38591c-4036-4ebd-9e35-ec888a857569 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c" status: 200 len: 1136 microversion: 2.1 time: 0.106950 May 25 16:25:50.462946 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 304/613] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:50 2022] GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c => generated 1136 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:50.515085 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-dc3099a7-ff6b-4624-8cdd-3441eadb123c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:50.515693 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-dc3099a7-ff6b-4624-8cdd-3441eadb123c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:50.523714 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dc3099a7-ff6b-4624-8cdd-3441eadb123c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:50.524161 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dc3099a7-ff6b-4624-8cdd-3441eadb123c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:50.524929 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dc3099a7-ff6b-4624-8cdd-3441eadb123c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:50.525363 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dc3099a7-ff6b-4624-8cdd-3441eadb123c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:50.763228 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-dc3099a7-ff6b-4624-8cdd-3441eadb123c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:50.770585 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-dc3099a7-ff6b-4624-8cdd-3441eadb123c tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44" status: 200 len: 1362 microversion: 2.1 time: 0.259728 May 25 16:25:50.771143 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 310/614] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:50 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44 => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:50.894279 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-2a86cce5-63e1-44e6-8e0e-3e4900669a60 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:50.895915 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-2a86cce5-63e1-44e6-8e0e-3e4900669a60 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:50.901677 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2a86cce5-63e1-44e6-8e0e-3e4900669a60 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:50.903115 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2a86cce5-63e1-44e6-8e0e-3e4900669a60 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:50.903945 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2a86cce5-63e1-44e6-8e0e-3e4900669a60 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:50.904693 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2a86cce5-63e1-44e6-8e0e-3e4900669a60 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:50.939909 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-2a86cce5-63e1-44e6-8e0e-3e4900669a60 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050983 May 25 16:25:50.940501 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 305/615] 10.222.0.42 () {58 vars in 1301 bytes} [Wed May 25 16:25:50 2022] GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 16:25:51.025355 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-4e7210ec-cf21-4ca3-bb30-b5a00ff594a7 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:51.026061 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-4e7210ec-cf21-4ca3-bb30-b5a00ff594a7 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:51.034411 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4e7210ec-cf21-4ca3-bb30-b5a00ff594a7 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:51.035249 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4e7210ec-cf21-4ca3-bb30-b5a00ff594a7 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:51.036169 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4e7210ec-cf21-4ca3-bb30-b5a00ff594a7 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:51.037021 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4e7210ec-cf21-4ca3-bb30-b5a00ff594a7 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:51.057012 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-24bb4d32-2c87-4166-aad3-5f579f251092 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:51.058982 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-24bb4d32-2c87-4166-aad3-5f579f251092 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:51.068796 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-4e7210ec-cf21-4ca3-bb30-b5a00ff594a7 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] Going to try to terminate instance {{(pid=117509) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:25:51.071235 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-24bb4d32-2c87-4166-aad3-5f579f251092 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:51.072660 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-24bb4d32-2c87-4166-aad3-5f579f251092 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:51.075763 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-24bb4d32-2c87-4166-aad3-5f579f251092 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:51.077707 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-24bb4d32-2c87-4166-aad3-5f579f251092 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:51.188738 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-4e7210ec-cf21-4ca3-bb30-b5a00ff594a7 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "DELETE /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af" status: 204 len: 0 microversion: 2.1 time: 0.167315 May 25 16:25:51.194895 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 311/616] 10.222.0.42 () {58 vars in 1238 bytes} [Wed May 25 16:25:51 2022] DELETE /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:25:51.202823 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-6082d944-2a4a-415a-9cae-7e7429e0457e tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:51.204851 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-6082d944-2a4a-415a-9cae-7e7429e0457e tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:51.210652 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:25:51.212430 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6082d944-2a4a-415a-9cae-7e7429e0457e tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:51.212914 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6082d944-2a4a-415a-9cae-7e7429e0457e tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:51.213677 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6082d944-2a4a-415a-9cae-7e7429e0457e tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:51.214147 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6082d944-2a4a-415a-9cae-7e7429e0457e tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:51.337400 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-24bb4d32-2c87-4166-aad3-5f579f251092 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:51.346142 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-24bb4d32-2c87-4166-aad3-5f579f251092 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1687 microversion: 2.1 time: 0.293998 May 25 16:25:51.346708 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 306/617] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:51 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1687 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:25:51.479456 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-00f4e48e-0fa1-4a6a-a6b1-96220ab53bdc tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:51.480190 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-00f4e48e-0fa1-4a6a-a6b1-96220ab53bdc tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:51.487391 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-00f4e48e-0fa1-4a6a-a6b1-96220ab53bdc tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:51.487860 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-00f4e48e-0fa1-4a6a-a6b1-96220ab53bdc tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:51.488633 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-00f4e48e-0fa1-4a6a-a6b1-96220ab53bdc tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:51.489077 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-00f4e48e-0fa1-4a6a-a6b1-96220ab53bdc tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:51.735716 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-6082d944-2a4a-415a-9cae-7e7429e0457e tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:51.736407 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-00f4e48e-0fa1-4a6a-a6b1-96220ab53bdc tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:51.746464 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-00f4e48e-0fa1-4a6a-a6b1-96220ab53bdc tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c" status: 200 len: 1210 microversion: 2.1 time: 0.270517 May 25 16:25:51.746795 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-6082d944-2a4a-415a-9cae-7e7429e0457e tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af" status: 200 len: 1682 microversion: 2.1 time: 0.549262 May 25 16:25:51.747350 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 312/618] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:51 2022] GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af => generated 1682 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:51.757221 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 307/619] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:51 2022] GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c => generated 1210 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:25:51.788738 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-b43de673-b9c1-4735-ab66-d9bbd6833aa0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:51.789635 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-b43de673-b9c1-4735-ab66-d9bbd6833aa0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:51.796777 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b43de673-b9c1-4735-ab66-d9bbd6833aa0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:51.797273 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b43de673-b9c1-4735-ab66-d9bbd6833aa0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:51.798220 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b43de673-b9c1-4735-ab66-d9bbd6833aa0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:51.798650 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b43de673-b9c1-4735-ab66-d9bbd6833aa0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:52.012108 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-b43de673-b9c1-4735-ab66-d9bbd6833aa0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:52.020717 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-b43de673-b9c1-4735-ab66-d9bbd6833aa0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44" status: 200 len: 1362 microversion: 2.1 time: 0.236602 May 25 16:25:52.030470 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 313/620] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:51 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44 => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:52.067825 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-a46693cf-83d9-497c-b8e5-766958f80190 req-3f15f065-bb3e-488a-946c-acfb290a4c76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f68f3730-3984-4aef-9c58-e87b09051c87", "name": "network-vif-deleted", "tag": "1b194465-a3bb-473d-8825-aed33ba4c44a"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:25:52.076313 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-a46693cf-83d9-497c-b8e5-766958f80190 req-3f15f065-bb3e-488a-946c-acfb290a4c76 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:52.076754 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-a46693cf-83d9-497c-b8e5-766958f80190 req-3f15f065-bb3e-488a-946c-acfb290a4c76 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:52.087530 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-a46693cf-83d9-497c-b8e5-766958f80190 req-3f15f065-bb3e-488a-946c-acfb290a4c76 service nova] Creating event network-vif-deleted:1b194465-a3bb-473d-8825-aed33ba4c44a for instance f68f3730-3984-4aef-9c58-e87b09051c87 on hv-cinder-84327 May 25 16:25:52.092546 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-a46693cf-83d9-497c-b8e5-766958f80190 req-3f15f065-bb3e-488a-946c-acfb290a4c76 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090371 May 25 16:25:52.093124 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 308/621] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:25:52.362991 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-3d5017c6-7881-4aa6-a69e-6fa035219212 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:52.363597 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-3d5017c6-7881-4aa6-a69e-6fa035219212 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:52.369566 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3d5017c6-7881-4aa6-a69e-6fa035219212 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:52.370051 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3d5017c6-7881-4aa6-a69e-6fa035219212 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:52.370822 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3d5017c6-7881-4aa6-a69e-6fa035219212 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:52.371386 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3d5017c6-7881-4aa6-a69e-6fa035219212 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:52.394174 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell0:SELECT=2 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:25:52.412799 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell0:SELECT=10 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:25:52.437830 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-3d5017c6-7881-4aa6-a69e-6fa035219212 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:52.445189 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-3d5017c6-7881-4aa6-a69e-6fa035219212 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1620 microversion: 2.1 time: 0.086104 May 25 16:25:52.445769 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 314/622] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:52 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1620 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:52.766984 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-58a9e3ba-8bd8-4ac4-9ff5-93746d05a04c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:52.767665 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-58a9e3ba-8bd8-4ac4-9ff5-93746d05a04c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:52.772440 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-10931794-63d7-40ab-a616-4da890456b69 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:52.773143 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-10931794-63d7-40ab-a616-4da890456b69 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:52.785349 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-58a9e3ba-8bd8-4ac4-9ff5-93746d05a04c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:52.787574 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-10931794-63d7-40ab-a616-4da890456b69 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:52.788207 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-58a9e3ba-8bd8-4ac4-9ff5-93746d05a04c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:52.789163 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-58a9e3ba-8bd8-4ac4-9ff5-93746d05a04c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:52.789998 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-10931794-63d7-40ab-a616-4da890456b69 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:52.790774 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-10931794-63d7-40ab-a616-4da890456b69 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:52.791216 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-10931794-63d7-40ab-a616-4da890456b69 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:52.795602 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-58a9e3ba-8bd8-4ac4-9ff5-93746d05a04c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:52.938201 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-58a9e3ba-8bd8-4ac4-9ff5-93746d05a04c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:52.948497 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-58a9e3ba-8bd8-4ac4-9ff5-93746d05a04c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c" status: 200 len: 1210 microversion: 2.1 time: 0.187691 May 25 16:25:52.952705 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 315/623] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:52 2022] GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c => generated 1210 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:53.039004 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-10931794-63d7-40ab-a616-4da890456b69 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:53.040601 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-f846b588-0dd3-42de-bbbe-9ceb09d463e2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:53.041991 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-f846b588-0dd3-42de-bbbe-9ceb09d463e2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:53.049231 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f846b588-0dd3-42de-bbbe-9ceb09d463e2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:53.049950 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f846b588-0dd3-42de-bbbe-9ceb09d463e2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:53.050788 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f846b588-0dd3-42de-bbbe-9ceb09d463e2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:53.051309 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f846b588-0dd3-42de-bbbe-9ceb09d463e2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:53.051859 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-10931794-63d7-40ab-a616-4da890456b69 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af" status: 200 len: 1682 microversion: 2.1 time: 0.288551 May 25 16:25:53.053840 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 309/624] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:52 2022] GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af => generated 1682 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:53.084251 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:25:53.210431 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-f846b588-0dd3-42de-bbbe-9ceb09d463e2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:53.218773 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-f846b588-0dd3-42de-bbbe-9ceb09d463e2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44" status: 200 len: 1362 microversion: 2.1 time: 0.185000 May 25 16:25:53.219339 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 316/625] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:53 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:25:53.461542 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-be4a8f20-03ad-41f7-9352-68dd0e62405f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:53.462267 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-be4a8f20-03ad-41f7-9352-68dd0e62405f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:53.465765 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:25:53.469882 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-be4a8f20-03ad-41f7-9352-68dd0e62405f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:53.470333 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-be4a8f20-03ad-41f7-9352-68dd0e62405f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:53.471106 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-be4a8f20-03ad-41f7-9352-68dd0e62405f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:53.471556 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-be4a8f20-03ad-41f7-9352-68dd0e62405f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:53.507225 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-be4a8f20-03ad-41f7-9352-68dd0e62405f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:53.507668 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-be4a8f20-03ad-41f7-9352-68dd0e62405f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:53.508108 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.objects.instance [None req-be4a8f20-03ad-41f7-9352-68dd0e62405f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lazy-loading 'fault' on Instance uuid f68f3730-3984-4aef-9c58-e87b09051c87 {{(pid=117510) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:25:53.510941 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:25:53.552325 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-be4a8f20-03ad-41f7-9352-68dd0e62405f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:53.561567 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-be4a8f20-03ad-41f7-9352-68dd0e62405f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 200 len: 1335 microversion: 2.1 time: 0.103835 May 25 16:25:53.562176 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 310/626] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:53 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 1335 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:53.969752 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-e2ef5193-63b0-47af-a236-b2e46cdff2ea tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:53.970358 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-e2ef5193-63b0-47af-a236-b2e46cdff2ea tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:53.976401 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e2ef5193-63b0-47af-a236-b2e46cdff2ea tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:53.976851 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e2ef5193-63b0-47af-a236-b2e46cdff2ea tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:53.977607 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e2ef5193-63b0-47af-a236-b2e46cdff2ea tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:53.978063 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e2ef5193-63b0-47af-a236-b2e46cdff2ea tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:54.070162 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-32d5872d-a6b9-4cf0-a6cc-8b49e2fa7832 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:54.070768 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-32d5872d-a6b9-4cf0-a6cc-8b49e2fa7832 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:54.077891 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-32d5872d-a6b9-4cf0-a6cc-8b49e2fa7832 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:54.078333 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-32d5872d-a6b9-4cf0-a6cc-8b49e2fa7832 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:54.079088 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-32d5872d-a6b9-4cf0-a6cc-8b49e2fa7832 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:54.079517 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-32d5872d-a6b9-4cf0-a6cc-8b49e2fa7832 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:54.113860 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-e2ef5193-63b0-47af-a236-b2e46cdff2ea tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:54.122020 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-e2ef5193-63b0-47af-a236-b2e46cdff2ea tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c" status: 200 len: 1266 microversion: 2.1 time: 0.156073 May 25 16:25:54.122605 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 317/627] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:53 2022] GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:25:54.208608 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-32d5872d-a6b9-4cf0-a6cc-8b49e2fa7832 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:54.216779 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-32d5872d-a6b9-4cf0-a6cc-8b49e2fa7832 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af" status: 200 len: 1682 microversion: 2.1 time: 0.150237 May 25 16:25:54.217280 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 311/628] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:54 2022] GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:25:54.235248 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-cef048a9-3a94-47cb-a1ac-256afbda9845 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:54.235856 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-cef048a9-3a94-47cb-a1ac-256afbda9845 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:54.241958 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-cef048a9-3a94-47cb-a1ac-256afbda9845 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:54.242415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-cef048a9-3a94-47cb-a1ac-256afbda9845 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:54.243298 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-cef048a9-3a94-47cb-a1ac-256afbda9845 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:54.243602 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-cef048a9-3a94-47cb-a1ac-256afbda9845 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:54.415493 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-cef048a9-3a94-47cb-a1ac-256afbda9845 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:54.423079 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-cef048a9-3a94-47cb-a1ac-256afbda9845 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44" status: 200 len: 1362 microversion: 2.1 time: 0.191577 May 25 16:25:54.428698 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 318/629] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:54 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:54.579442 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-e1a8b195-c205-41c2-9834-abe0795f0588 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:54.580043 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-e1a8b195-c205-41c2-9834-abe0795f0588 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: f68f3730-3984-4aef-9c58-e87b09051c87] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:54.585995 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e1a8b195-c205-41c2-9834-abe0795f0588 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:54.586444 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e1a8b195-c205-41c2-9834-abe0795f0588 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:54.587209 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e1a8b195-c205-41c2-9834-abe0795f0588 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:54.587624 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e1a8b195-c205-41c2-9834-abe0795f0588 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:54.600600 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.wsgi [None req-e1a8b195-c205-41c2-9834-abe0795f0588 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] HTTP exception thrown: Instance f68f3730-3984-4aef-9c58-e87b09051c87 could not be found. May 25 16:25:54.602232 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-e1a8b195-c205-41c2-9834-abe0795f0588 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Request method failure captured: May 25 16:25:54.602232 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: request: GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 HTTP/1.1 May 25 16:25:54.602232 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept: application/json May 25 16:25:54.602232 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept-Encoding: identity May 25 16:25:54.602232 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Connection: close May 25 16:25:54.602232 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Length: 0 May 25 16:25:54.602232 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Type: application/json May 25 16:25:54.602232 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Host: 10.222.0.42 May 25 16:25:54.602232 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Openstack-System-Scope: None May 25 16:25:54.602232 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: User-Agent: python-urllib3/1.26.9 May 25 16:25:54.602232 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Auth-Token: gAAAAABijldYEk-vXf1RzTAhtuBmZCP64e-jFGtt4_4AUU4JvgXjFozEXheYHuLBoLnaDKX2hw8HHhJRSLtnCpwINlrLr_XZWKytjwNPB5nW99kaEc4sI4nUx8x4Ptx9q5FVs8jmBgiEaPPAaP7XvfqFLdfWYv34Y_gMy5FtTHmgzN_RasZUKJo May 25 16:25:54.602232 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Id: None May 25 16:25:54.602232 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Name: None May 25 16:25:54.602232 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Identity-Status: Confirmed May 25 16:25:54.602232 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Is-Admin-Project: True May 25 16:25:54.602232 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Id: default May 25 16:25:54.602232 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Name: Default May 25 16:25:54.602232 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Id: 95d1e25b20a146c198dfeda0dc43cd72 May 25 16:25:54.602232 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1964636607 May 25 16:25:54.602232 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Role: reader,member May 25 16:25:54.602232 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Roles: reader,member May 25 16:25:54.603753 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/95d1e25b20a146c198dfeda0dc43cd72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/95d1e25b20a146c198dfeda0dc43cd72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_95d1e25b20a146c198dfeda0dc43cd72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/95d1e25b20a146c198dfeda0dc43cd72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:25:54.603753 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1964636607 May 25 16:25:54.603753 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Id: 95d1e25b20a146c198dfeda0dc43cd72 May 25 16:25:54.603753 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1964636607 May 25 16:25:54.603753 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User: tempest-ServerRescueNegativeTestJSON-1964636607-project May 25 16:25:54.603753 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Id: default May 25 16:25:54.603753 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Name: Default May 25 16:25:54.603753 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Id: 30de794b71b343289491531dfbe37f53 May 25 16:25:54.603753 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1964636607-project May 25 16:25:54.603753 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: method: > May 25 16:25:54.603753 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: exception: Instance f68f3730-3984-4aef-9c58-e87b09051c87 could not be found. May 25 16:25:54.603753 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: action_args: {'id': 'f68f3730-3984-4aef-9c58-e87b09051c87'} May 25 16:25:54.608119 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:25:54.608119 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:25:54.608119 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:25:54.608119 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:25:54.608119 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:25:54.608119 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:25:54.608119 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:25:54.608119 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:25:54.608119 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:25:54.608119 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:25:54.608119 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f68f3730-3984-4aef-9c58-e87b09051c87 could not be found. May 25 16:25:54.608119 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:25:54.608119 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:25:54.608119 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:25:54.608119 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:25:54.608119 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:25:54.608119 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:25:54.608119 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:25:54.608119 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:25:54.608119 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:25:54.609473 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:25:54.609473 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:25:54.609473 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:25:54.609473 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:25:54.609473 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:25:54.609473 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:25:54.609473 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:25:54.609473 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f68f3730-3984-4aef-9c58-e87b09051c87 could not be found. May 25 16:25:54.609473 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:25:54.609473 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:25:54.609473 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:25:54.609473 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:25:54.609473 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:25:54.609473 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:25:54.609473 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:25:54.609473 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:25:54.609473 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f68f3730-3984-4aef-9c58-e87b09051c87 could not be found. May 25 16:25:54.609473 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:25:54.610963 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-e1a8b195-c205-41c2-9834-abe0795f0588 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Returning 404 to user: Instance f68f3730-3984-4aef-9c58-e87b09051c87 could not be found. {{(pid=117510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:25:54.610963 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-e1a8b195-c205-41c2-9834-abe0795f0588 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87" status: 404 len: 111 microversion: 2.1 time: 0.028155 May 25 16:25:54.610963 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 312/630] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:54 2022] GET /compute/v2.1/servers/f68f3730-3984-4aef-9c58-e87b09051c87 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:25:54.613958 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-f44e0e20-f1b9-4399-a5a2-0d860bb9d36c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '.version_select at 0x7f51ee165af0>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:54.632495 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-f44e0e20-f1b9-4399-a5a2-0d860bb9d36c tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1403812730" status: 202 len: 0 microversion: 2.1 time: 0.023546 May 25 16:25:54.633256 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 319/631] 10.222.0.42 () {58 vars in 1220 bytes} [Wed May 25 16:25:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1403812730 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:25:55.139680 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-a1f91788-991b-40ca-8b7d-0e777ccefb21 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:55.141088 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-a1f91788-991b-40ca-8b7d-0e777ccefb21 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:55.151848 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a1f91788-991b-40ca-8b7d-0e777ccefb21 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:55.152913 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a1f91788-991b-40ca-8b7d-0e777ccefb21 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:55.154147 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a1f91788-991b-40ca-8b7d-0e777ccefb21 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:55.154775 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a1f91788-991b-40ca-8b7d-0e777ccefb21 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:55.234648 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-e34766bb-f8f9-458c-ae4b-d619502e496a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:55.235259 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-e34766bb-f8f9-458c-ae4b-d619502e496a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:55.251565 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e34766bb-f8f9-458c-ae4b-d619502e496a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:55.252015 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e34766bb-f8f9-458c-ae4b-d619502e496a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:55.252799 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e34766bb-f8f9-458c-ae4b-d619502e496a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:55.253232 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e34766bb-f8f9-458c-ae4b-d619502e496a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:55.396173 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-e34766bb-f8f9-458c-ae4b-d619502e496a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:55.405346 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-e34766bb-f8f9-458c-ae4b-d619502e496a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af" status: 200 len: 1614 microversion: 2.1 time: 0.175099 May 25 16:25:55.406106 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 320/632] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:55 2022] GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af => generated 1614 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:55.435940 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-a1f91788-991b-40ca-8b7d-0e777ccefb21 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:55.441328 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-973f9034-b392-4795-9578-46c0010c5b5e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:55.441977 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-973f9034-b392-4795-9578-46c0010c5b5e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:55.445374 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-a1f91788-991b-40ca-8b7d-0e777ccefb21 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c" status: 200 len: 1266 microversion: 2.1 time: 0.309900 May 25 16:25:55.446330 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 313/633] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:55 2022] GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c => generated 1266 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:55.449649 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-973f9034-b392-4795-9578-46c0010c5b5e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:55.450376 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-973f9034-b392-4795-9578-46c0010c5b5e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:55.451165 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-973f9034-b392-4795-9578-46c0010c5b5e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:55.451661 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-973f9034-b392-4795-9578-46c0010c5b5e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:55.531778 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-c701261c-20eb-4098-94c1-afbdedd85c51 req-095b3623-abac-4fc0-ae12-337449b2db1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5ebfa48-d140-464a-8556-590a2666ce0c", "tag": "414a4851-4f1f-4eac-9236-89ed850b9b5a"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:25:55.552405 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-c701261c-20eb-4098-94c1-afbdedd85c51 req-095b3623-abac-4fc0-ae12-337449b2db1f service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:55.553432 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-c701261c-20eb-4098-94c1-afbdedd85c51 req-095b3623-abac-4fc0-ae12-337449b2db1f service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:55.571743 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-c701261c-20eb-4098-94c1-afbdedd85c51 req-095b3623-abac-4fc0-ae12-337449b2db1f service nova] Creating event network-changed:414a4851-4f1f-4eac-9236-89ed850b9b5a for instance b5ebfa48-d140-464a-8556-590a2666ce0c on hv-cinder-84327 May 25 16:25:55.578295 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-c701261c-20eb-4098-94c1-afbdedd85c51 req-095b3623-abac-4fc0-ae12-337449b2db1f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053529 May 25 16:25:55.579499 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 314/634] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:25:55.650817 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-973f9034-b392-4795-9578-46c0010c5b5e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:55.660778 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-973f9034-b392-4795-9578-46c0010c5b5e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44" status: 200 len: 1362 microversion: 2.1 time: 0.223841 May 25 16:25:55.661466 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 321/635] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:55 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44 => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:56.424465 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-ff349f0f-d663-49f6-8d79-8b263a0a1d85 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:56.425390 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-ff349f0f-d663-49f6-8d79-8b263a0a1d85 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:56.427935 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell0:SELECT=2 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:25:56.428912 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell0:SELECT=10 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:25:56.438168 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ff349f0f-d663-49f6-8d79-8b263a0a1d85 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:56.438168 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ff349f0f-d663-49f6-8d79-8b263a0a1d85 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:56.438978 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ff349f0f-d663-49f6-8d79-8b263a0a1d85 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:56.439604 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ff349f0f-d663-49f6-8d79-8b263a0a1d85 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:56.467977 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-b23bcb8a-8f3c-491c-bd85-0e2c159cc271 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:56.468593 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-b23bcb8a-8f3c-491c-bd85-0e2c159cc271 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:56.494874 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b23bcb8a-8f3c-491c-bd85-0e2c159cc271 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:56.494874 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b23bcb8a-8f3c-491c-bd85-0e2c159cc271 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:56.495498 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b23bcb8a-8f3c-491c-bd85-0e2c159cc271 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:56.495977 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b23bcb8a-8f3c-491c-bd85-0e2c159cc271 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:56.523546 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ff349f0f-d663-49f6-8d79-8b263a0a1d85 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:56.524353 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ff349f0f-d663-49f6-8d79-8b263a0a1d85 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:56.525471 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.objects.instance [None req-ff349f0f-d663-49f6-8d79-8b263a0a1d85 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lazy-loading 'fault' on Instance uuid 125fb239-87ee-4665-94f5-252ee52d73af {{(pid=117510) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:25:56.684074 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-ff349f0f-d663-49f6-8d79-8b263a0a1d85 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:56.696465 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-ff349f0f-d663-49f6-8d79-8b263a0a1d85 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af" status: 200 len: 1331 microversion: 2.1 time: 0.276209 May 25 16:25:56.709062 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 315/636] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:56 2022] GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af => generated 1331 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:56.715506 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-f292bc4b-5128-4e3b-8ced-b5a9b15e1243 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:56.717045 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-f292bc4b-5128-4e3b-8ced-b5a9b15e1243 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:56.723852 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f292bc4b-5128-4e3b-8ced-b5a9b15e1243 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:56.724660 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f292bc4b-5128-4e3b-8ced-b5a9b15e1243 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:56.725434 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f292bc4b-5128-4e3b-8ced-b5a9b15e1243 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:56.726056 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f292bc4b-5128-4e3b-8ced-b5a9b15e1243 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:56.829320 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-b23bcb8a-8f3c-491c-bd85-0e2c159cc271 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:56.841991 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-b23bcb8a-8f3c-491c-bd85-0e2c159cc271 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c" status: 200 len: 1266 microversion: 2.1 time: 0.379890 May 25 16:25:56.843071 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 322/637] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:56 2022] GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c => generated 1266 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:56.910358 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-f292bc4b-5128-4e3b-8ced-b5a9b15e1243 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:56.921257 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-f292bc4b-5128-4e3b-8ced-b5a9b15e1243 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44" status: 200 len: 1362 microversion: 2.1 time: 0.208760 May 25 16:25:56.922881 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 316/638] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:56 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:57.691395 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-b6bf829b-6f39-4898-ac3a-fa019367ede0 req-ac475fd9-0da4-4675-a8d6-dacc4a4d65f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "125fb239-87ee-4665-94f5-252ee52d73af", "name": "network-vif-deleted", "tag": "e7088f01-c534-435d-adca-470dfe4db83d"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:25:57.699705 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-b6bf829b-6f39-4898-ac3a-fa019367ede0 req-ac475fd9-0da4-4675-a8d6-dacc4a4d65f9 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:57.700177 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-b6bf829b-6f39-4898-ac3a-fa019367ede0 req-ac475fd9-0da4-4675-a8d6-dacc4a4d65f9 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:57.710701 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-b6bf829b-6f39-4898-ac3a-fa019367ede0 req-ac475fd9-0da4-4675-a8d6-dacc4a4d65f9 service nova] Creating event network-vif-deleted:e7088f01-c534-435d-adca-470dfe4db83d for instance 125fb239-87ee-4665-94f5-252ee52d73af on hv-cinder-84327 May 25 16:25:57.716436 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-b6bf829b-6f39-4898-ac3a-fa019367ede0 req-ac475fd9-0da4-4675-a8d6-dacc4a4d65f9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082899 May 25 16:25:57.717013 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 323/639] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:25:57.717909 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-30893702-7bc4-4af9-bdb5-0adc4b95ece0 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:57.718523 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-30893702-7bc4-4af9-bdb5-0adc4b95ece0 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:57.725036 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-30893702-7bc4-4af9-bdb5-0adc4b95ece0 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:57.725515 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-30893702-7bc4-4af9-bdb5-0adc4b95ece0 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:57.726302 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-30893702-7bc4-4af9-bdb5-0adc4b95ece0 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:57.726737 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-30893702-7bc4-4af9-bdb5-0adc4b95ece0 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:57.740596 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.wsgi [None req-30893702-7bc4-4af9-bdb5-0adc4b95ece0 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] HTTP exception thrown: Instance 125fb239-87ee-4665-94f5-252ee52d73af could not be found. May 25 16:25:57.742244 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-30893702-7bc4-4af9-bdb5-0adc4b95ece0 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Request method failure captured: May 25 16:25:57.742244 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: request: GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af HTTP/1.1 May 25 16:25:57.742244 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept: application/json May 25 16:25:57.742244 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept-Encoding: identity May 25 16:25:57.742244 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Connection: close May 25 16:25:57.742244 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Length: 0 May 25 16:25:57.742244 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Type: application/json May 25 16:25:57.742244 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Host: 10.222.0.42 May 25 16:25:57.742244 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Openstack-System-Scope: None May 25 16:25:57.742244 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: User-Agent: python-urllib3/1.26.9 May 25 16:25:57.742244 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Auth-Token: gAAAAABijldM9TsAZJy8dFB1DMOmN3fYD4FVUv3HZ7K9WxI11fcxXnHOFEKVQuqoz4pXUAyb9YMnHusiEz5_9NIfv66CxCRP6OYrV0TQFouqehYLNaYvAb5OzaoSF8oLgazxJMBBuxROCk5D-B6RTnZ7yadTSJVodvBMZSALenmgyavmYCv9RJ0 May 25 16:25:57.742244 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Id: None May 25 16:25:57.742244 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Name: None May 25 16:25:57.742244 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Identity-Status: Confirmed May 25 16:25:57.742244 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Is-Admin-Project: True May 25 16:25:57.742244 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Id: default May 25 16:25:57.742244 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Name: Default May 25 16:25:57.742244 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Id: 9d234edace28441282f594f0e03cacc5 May 25 16:25:57.742244 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Name: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:25:57.742244 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Role: reader,member May 25 16:25:57.742244 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Roles: reader,member May 25 16:25:57.743723 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d234edace28441282f594f0e03cacc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d234edace28441282f594f0e03cacc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d234edace28441282f594f0e03cacc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d234edace28441282f594f0e03cacc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:25:57.743723 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:25:57.743723 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Id: 9d234edace28441282f594f0e03cacc5 May 25 16:25:57.743723 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:25:57.743723 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User: tempest-AttachVolumeNegativeTest-1719621589-project May 25 16:25:57.743723 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Id: default May 25 16:25:57.743723 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Name: Default May 25 16:25:57.743723 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Id: b781c4c6cb61439fb781988a7da028ff May 25 16:25:57.743723 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Name: tempest-AttachVolumeNegativeTest-1719621589-project May 25 16:25:57.743723 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: method: > May 25 16:25:57.743723 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: exception: Instance 125fb239-87ee-4665-94f5-252ee52d73af could not be found. May 25 16:25:57.743723 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: action_args: {'id': '125fb239-87ee-4665-94f5-252ee52d73af'} May 25 16:25:57.744611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:25:57.744611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:25:57.744611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:25:57.744611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:25:57.744611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:25:57.744611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:25:57.744611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:25:57.744611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:25:57.744611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:25:57.744611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:25:57.744611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 125fb239-87ee-4665-94f5-252ee52d73af could not be found. May 25 16:25:57.744611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:25:57.744611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:25:57.744611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:25:57.744611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:25:57.744611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:25:57.744611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:25:57.744611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:25:57.744611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:25:57.744611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:25:57.746071 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:25:57.746071 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:25:57.746071 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:25:57.746071 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:25:57.746071 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:25:57.746071 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:25:57.746071 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:25:57.746071 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 125fb239-87ee-4665-94f5-252ee52d73af could not be found. May 25 16:25:57.746071 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:25:57.746071 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:25:57.746071 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:25:57.746071 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:25:57.746071 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:25:57.746071 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:25:57.746071 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:25:57.746071 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:25:57.746071 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 125fb239-87ee-4665-94f5-252ee52d73af could not be found. May 25 16:25:57.746071 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:25:57.747423 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-30893702-7bc4-4af9-bdb5-0adc4b95ece0 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Returning 404 to user: Instance 125fb239-87ee-4665-94f5-252ee52d73af could not be found. {{(pid=117510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:25:57.747423 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-30893702-7bc4-4af9-bdb5-0adc4b95ece0 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af" status: 404 len: 111 microversion: 2.1 time: 0.031253 May 25 16:25:57.747423 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 317/640] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:57 2022] GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:25:57.753456 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-e35b420b-363f-48ae-8687-79372ea63e68 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '.version_select at 0x7f51ee19b550>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:57.770348 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-e35b420b-363f-48ae-8687-79372ea63e68 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-850530092" status: 202 len: 0 microversion: 2.1 time: 0.020953 May 25 16:25:57.770913 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 324/641] 10.222.0.42 () {58 vars in 1217 bytes} [Wed May 25 16:25:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-850530092 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:25:57.859929 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-f4cb09a2-1fdd-43a0-92e1-69b3fcfb865c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:57.860633 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-f4cb09a2-1fdd-43a0-92e1-69b3fcfb865c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:57.868427 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f4cb09a2-1fdd-43a0-92e1-69b3fcfb865c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:57.868985 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f4cb09a2-1fdd-43a0-92e1-69b3fcfb865c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:57.869953 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f4cb09a2-1fdd-43a0-92e1-69b3fcfb865c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:57.870923 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f4cb09a2-1fdd-43a0-92e1-69b3fcfb865c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:57.875319 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-a7ad7a45-602c-4907-8e7e-e46f2286bcf0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:57.876158 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-a7ad7a45-602c-4907-8e7e-e46f2286bcf0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:57.882535 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a7ad7a45-602c-4907-8e7e-e46f2286bcf0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:57.883168 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a7ad7a45-602c-4907-8e7e-e46f2286bcf0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:57.884115 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a7ad7a45-602c-4907-8e7e-e46f2286bcf0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:57.884707 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a7ad7a45-602c-4907-8e7e-e46f2286bcf0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:57.915764 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-a7ad7a45-602c-4907-8e7e-e46f2286bcf0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Going to try to terminate instance {{(pid=117509) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:25:58.014160 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-a7ad7a45-602c-4907-8e7e-e46f2286bcf0 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "DELETE /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 204 len: 0 microversion: 2.1 time: 0.142429 May 25 16:25:58.018232 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 325/642] 10.222.0.42 () {58 vars in 1238 bytes} [Wed May 25 16:25:57 2022] DELETE /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 25 16:25:58.024364 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-f5011733-8f2d-4d57-9588-2d8cecc78e6d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:58.025376 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-f5011733-8f2d-4d57-9588-2d8cecc78e6d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:58.033635 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f5011733-8f2d-4d57-9588-2d8cecc78e6d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:58.034923 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f5011733-8f2d-4d57-9588-2d8cecc78e6d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:58.035809 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f5011733-8f2d-4d57-9588-2d8cecc78e6d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:58.036214 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f5011733-8f2d-4d57-9588-2d8cecc78e6d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:58.161531 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-f4cb09a2-1fdd-43a0-92e1-69b3fcfb865c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:58.171369 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-f4cb09a2-1fdd-43a0-92e1-69b3fcfb865c tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c" status: 200 len: 1266 microversion: 2.1 time: 0.315989 May 25 16:25:58.171953 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 318/643] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:57 2022] GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c => generated 1266 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:58.178326 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-1ee14c5c-0949-4021-9a9e-e04325055338 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:58.179483 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-1ee14c5c-0949-4021-9a9e-e04325055338 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:58.187977 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1ee14c5c-0949-4021-9a9e-e04325055338 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:58.188472 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1ee14c5c-0949-4021-9a9e-e04325055338 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:58.189392 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1ee14c5c-0949-4021-9a9e-e04325055338 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:58.189880 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1ee14c5c-0949-4021-9a9e-e04325055338 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:58.339628 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-f5011733-8f2d-4d57-9588-2d8cecc78e6d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:58.347306 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-f5011733-8f2d-4d57-9588-2d8cecc78e6d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44" status: 200 len: 1362 microversion: 2.1 time: 0.327941 May 25 16:25:58.347958 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 326/644] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:58 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44 => generated 1362 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:58.409007 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-7d15b70e-1346-4e32-9c87-bda3d12adc5a req-cf733685-005a-4480-9ffe-3d5e2747303d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50c1e1a5-ce7f-4032-b028-431051dfde44", "name": "network-vif-plugged", "status": "completed", "tag": "a3612e40-f8ea-4391-b684-977f3fa2cfff"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:25:58.417214 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-7d15b70e-1346-4e32-9c87-bda3d12adc5a req-cf733685-005a-4480-9ffe-3d5e2747303d service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:58.417814 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-7d15b70e-1346-4e32-9c87-bda3d12adc5a req-cf733685-005a-4480-9ffe-3d5e2747303d service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:58.428492 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-7d15b70e-1346-4e32-9c87-bda3d12adc5a req-cf733685-005a-4480-9ffe-3d5e2747303d service nova] Creating event network-vif-plugged:a3612e40-f8ea-4391-b684-977f3fa2cfff for instance 50c1e1a5-ce7f-4032-b028-431051dfde44 on hv-cinder-84327 May 25 16:25:58.435877 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-7d15b70e-1346-4e32-9c87-bda3d12adc5a req-cf733685-005a-4480-9ffe-3d5e2747303d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086692 May 25 16:25:58.437065 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 327/645] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:25:58.440011 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-1ee14c5c-0949-4021-9a9e-e04325055338 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:58.447486 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-1ee14c5c-0949-4021-9a9e-e04325055338 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1506 microversion: 2.1 time: 0.274385 May 25 16:25:58.448127 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 319/646] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:58 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1506 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:58.639853 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-02ef3e63-0010-4e12-838f-77e2b5e64cbc tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Action: 'create', calling method: .version_select at 0x7f51ee19b550>, body: {"keypair": {"name": "tempest-keypair-1727039587", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVmWpuuxhn6VzzpIKC4QUA8qfjsuDpC8rZcCGFYqcQyI+z4DnBJPh6JHj4ceBjCeJjF8qIhCLGSxn/uBtCsY9NwGPVdB3o7X0TVGn2JZN1GE4dtOM507/HGntrY0kFLWw=="}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:25:58.653373 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-02ef3e63-0010-4e12-838f-77e2b5e64cbc tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Getting quotas for project 9d234edace28441282f594f0e03cacc5. Resources: {'key_pairs'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:25:58.657027 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-02ef3e63-0010-4e12-838f-77e2b5e64cbc tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Getting quotas for user b781c4c6cb61439fb781988a7da028ff and project 9d234edace28441282f594f0e03cacc5. Resources: {'key_pairs'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:25:58.678336 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-02ef3e63-0010-4e12-838f-77e2b5e64cbc tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043620 May 25 16:25:58.678904 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 328/647] 10.222.0.42 () {60 vars in 1158 bytes} [Wed May 25 16:25:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:25:59.189007 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-dbc924e2-64f6-43b3-8bfb-dd6f097e6d9e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:59.189982 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-dbc924e2-64f6-43b3-8bfb-dd6f097e6d9e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:59.197700 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dbc924e2-64f6-43b3-8bfb-dd6f097e6d9e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:59.198251 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dbc924e2-64f6-43b3-8bfb-dd6f097e6d9e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:59.199211 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dbc924e2-64f6-43b3-8bfb-dd6f097e6d9e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:59.199816 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dbc924e2-64f6-43b3-8bfb-dd6f097e6d9e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:59.364532 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-b66c9c0d-dbe5-4e73-af61-24b7e3e8b6cc tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:59.365372 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-b66c9c0d-dbe5-4e73-af61-24b7e3e8b6cc tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:59.371725 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b66c9c0d-dbe5-4e73-af61-24b7e3e8b6cc tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:59.372193 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b66c9c0d-dbe5-4e73-af61-24b7e3e8b6cc tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:59.373179 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b66c9c0d-dbe5-4e73-af61-24b7e3e8b6cc tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:59.373609 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b66c9c0d-dbe5-4e73-af61-24b7e3e8b6cc tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:59.432814 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-dbc924e2-64f6-43b3-8bfb-dd6f097e6d9e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:59.440748 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-dbc924e2-64f6-43b3-8bfb-dd6f097e6d9e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c" status: 200 len: 1266 microversion: 2.1 time: 0.256193 May 25 16:25:59.441421 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 320/648] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:59 2022] GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:25:59.464270 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-f21aa32b-95f6-4425-8d41-b8d72731ee44 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:25:59.465948 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-f21aa32b-95f6-4425-8d41-b8d72731ee44 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:25:59.471937 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f21aa32b-95f6-4425-8d41-b8d72731ee44 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:59.472464 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f21aa32b-95f6-4425-8d41-b8d72731ee44 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:59.473297 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f21aa32b-95f6-4425-8d41-b8d72731ee44 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:25:59.473836 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f21aa32b-95f6-4425-8d41-b8d72731ee44 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:25:59.606712 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-b66c9c0d-dbe5-4e73-af61-24b7e3e8b6cc tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:59.614273 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-b66c9c0d-dbe5-4e73-af61-24b7e3e8b6cc tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44" status: 200 len: 1362 microversion: 2.1 time: 0.254212 May 25 16:25:59.614843 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 329/649] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:59 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44 => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:25:59.695286 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-f21aa32b-95f6-4425-8d41-b8d72731ee44 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:25:59.704042 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-f21aa32b-95f6-4425-8d41-b8d72731ee44 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1506 microversion: 2.1 time: 0.243544 May 25 16:25:59.704927 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 321/650] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:25:59 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1506 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:26:00.145165 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-857d0254-fd5e-47d3-b272-63ce5a38454a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2009865188", "imageRef": "e74cccc1-cd1b-4dfc-8e47-3e4a832649a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "924a9156-87e8-4a10-ac35-4ba66726a4f5"}], "security_groups": [{"name": "tempest-securitygroup--372738073"}], "key_name": "tempest-keypair-1727039587", "user_data": "}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:26:00.250312 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.network.neutron [None req-857d0254-fd5e-47d3-b272-63ce5a38454a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] validate_networks() for [('924a9156-87e8-4a10-ac35-4ba66726a4f5', None, None, None, None, None)] {{(pid=117509) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:26:00.466094 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-21f3c15a-e51f-4f91-bea9-cb5c7754b465 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:00.466627 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-21f3c15a-e51f-4f91-bea9-cb5c7754b465 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:00.472642 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-21f3c15a-e51f-4f91-bea9-cb5c7754b465 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:00.473096 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-21f3c15a-e51f-4f91-bea9-cb5c7754b465 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:00.473899 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-21f3c15a-e51f-4f91-bea9-cb5c7754b465 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:00.475365 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-21f3c15a-e51f-4f91-bea9-cb5c7754b465 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:00.505058 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-21f3c15a-e51f-4f91-bea9-cb5c7754b465 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8/ips" status: 200 len: 153 microversion: 2.20 time: 0.103753 May 25 16:26:00.505537 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 322/651] 10.222.0.42 () {60 vars in 1288 bytes} [Wed May 25 16:26:00 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8/ips => generated 153 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 16:26:00.510009 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-71c761eb-4872-4426-8daf-e9c5ed57f0b8 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:00.510705 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-71c761eb-4872-4426-8daf-e9c5ed57f0b8 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:00.519135 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-71c761eb-4872-4426-8daf-e9c5ed57f0b8 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:00.519341 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-71c761eb-4872-4426-8daf-e9c5ed57f0b8 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:00.520079 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-71c761eb-4872-4426-8daf-e9c5ed57f0b8 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:00.520519 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-71c761eb-4872-4426-8daf-e9c5ed57f0b8 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:00.756012 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-857d0254-fd5e-47d3-b272-63ce5a38454a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Flavor limits 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:26:00.757021 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-857d0254-fd5e-47d3-b272-63ce5a38454a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Image limits 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:26:00.757646 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-857d0254-fd5e-47d3-b272-63ce5a38454a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Flavor pref 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:26:00.758432 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-857d0254-fd5e-47d3-b272-63ce5a38454a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Image pref 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:26:00.758999 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-857d0254-fd5e-47d3-b272-63ce5a38454a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:26:00.780761 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-857d0254-fd5e-47d3-b272-63ce5a38454a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:00.781500 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-857d0254-fd5e-47d3-b272-63ce5a38454a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:00.782546 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-71c761eb-4872-4426-8daf-e9c5ed57f0b8 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:00.782755 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-857d0254-fd5e-47d3-b272-63ce5a38454a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:00.783335 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-857d0254-fd5e-47d3-b272-63ce5a38454a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:00.804957 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-71c761eb-4872-4426-8daf-e9c5ed57f0b8 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c" status: 200 len: 1266 microversion: 2.1 time: 0.296698 May 25 16:26:00.805274 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-857d0254-fd5e-47d3-b272-63ce5a38454a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Getting quotas for project 9d234edace28441282f594f0e03cacc5. Resources: {'ram', 'cores', 'instances'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:26:00.807817 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 323/652] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:00 2022] GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c => generated 1266 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:26:00.820780 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-857d0254-fd5e-47d3-b272-63ce5a38454a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Getting quotas for user b781c4c6cb61439fb781988a7da028ff and project 9d234edace28441282f594f0e03cacc5. Resources: {'ram', 'cores', 'instances'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:26:00.822000 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-f01a33d9-4660-48b9-b0a8-1043672caaa0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:00.822775 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-f01a33d9-4660-48b9-b0a8-1043672caaa0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:00.835937 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-857d0254-fd5e-47d3-b272-63ce5a38454a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Going to run 1 instances... {{(pid=117509) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:26:00.836549 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f01a33d9-4660-48b9-b0a8-1043672caaa0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:00.837020 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f01a33d9-4660-48b9-b0a8-1043672caaa0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:00.837848 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f01a33d9-4660-48b9-b0a8-1043672caaa0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:00.838293 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f01a33d9-4660-48b9-b0a8-1043672caaa0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:00.840324 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-857d0254-fd5e-47d3-b272-63ce5a38454a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e74cccc1-cd1b-4dfc-8e47-3e4a832649a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:26:00.901683 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-857d0254-fd5e-47d3-b272-63ce5a38454a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.760613 May 25 16:26:00.903240 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 330/653] 10.222.0.42 () {60 vars in 1146 bytes} [Wed May 25 16:26:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:26:00.908392 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-e8b96945-4b15-47f5-981a-9186a7cc584b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:00.909252 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-e8b96945-4b15-47f5-981a-9186a7cc584b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:00.917612 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e8b96945-4b15-47f5-981a-9186a7cc584b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:00.918461 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e8b96945-4b15-47f5-981a-9186a7cc584b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:00.919311 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e8b96945-4b15-47f5-981a-9186a7cc584b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:00.919753 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e8b96945-4b15-47f5-981a-9186a7cc584b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:01.059345 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-f01a33d9-4660-48b9-b0a8-1043672caaa0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:01.070381 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-f01a33d9-4660-48b9-b0a8-1043672caaa0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44" status: 200 len: 1362 microversion: 2.1 time: 0.260029 May 25 16:26:01.071783 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 324/654] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:00 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44 => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:26:01.077401 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-bafe1d0d-7438-474e-b0bf-3b4fdf359e75 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:01.078332 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-bafe1d0d-7438-474e-b0bf-3b4fdf359e75 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:01.162695 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-bafe1d0d-7438-474e-b0bf-3b4fdf359e75 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:01.174926 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-bafe1d0d-7438-474e-b0bf-3b4fdf359e75 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5" status: 200 len: 1242 microversion: 2.1 time: 0.101095 May 25 16:26:01.175713 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 325/655] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:01 2022] GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 => generated 1242 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:26:01.188451 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-e8b96945-4b15-47f5-981a-9186a7cc584b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:01.203873 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-e8b96945-4b15-47f5-981a-9186a7cc584b tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1506 microversion: 2.1 time: 0.299271 May 25 16:26:01.204783 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 331/656] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:00 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:26:01.241223 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-0c57a890-07fe-4701-ad74-635f446141b8 req-576d0390-79d2-4d7e-9793-ffec3fbc9de1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "756c834d-49bb-4cd7-b5c7-7140c66b0d0c", "name": "network-vif-deleted", "tag": "32e483c1-8f09-4e2a-9e95-ef7a5e449743"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:26:01.249955 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-0c57a890-07fe-4701-ad74-635f446141b8 req-576d0390-79d2-4d7e-9793-ffec3fbc9de1 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:01.250393 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-0c57a890-07fe-4701-ad74-635f446141b8 req-576d0390-79d2-4d7e-9793-ffec3fbc9de1 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:01.267924 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-0c57a890-07fe-4701-ad74-635f446141b8 req-576d0390-79d2-4d7e-9793-ffec3fbc9de1 service nova] Creating event network-vif-deleted:32e483c1-8f09-4e2a-9e95-ef7a5e449743 for instance 756c834d-49bb-4cd7-b5c7-7140c66b0d0c on hv-cinder-84327 May 25 16:26:01.274447 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-0c57a890-07fe-4701-ad74-635f446141b8 req-576d0390-79d2-4d7e-9793-ffec3fbc9de1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036736 May 25 16:26:01.275482 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 326/657] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:26:01.822950 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-0058a6aa-57fd-4a1c-aae1-47aafa7629d2 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:01.823563 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-0058a6aa-57fd-4a1c-aae1-47aafa7629d2 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:01.830509 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0058a6aa-57fd-4a1c-aae1-47aafa7629d2 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:01.831039 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0058a6aa-57fd-4a1c-aae1-47aafa7629d2 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:01.831919 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0058a6aa-57fd-4a1c-aae1-47aafa7629d2 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:01.832378 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0058a6aa-57fd-4a1c-aae1-47aafa7629d2 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:01.968162 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-0058a6aa-57fd-4a1c-aae1-47aafa7629d2 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:01.975720 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-0058a6aa-57fd-4a1c-aae1-47aafa7629d2 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c" status: 200 len: 1266 microversion: 2.1 time: 0.156872 May 25 16:26:01.976328 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 332/658] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:01 2022] GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:26:02.089956 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-aa93f93f-065f-463e-9ad4-a15653a4e3a0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:02.091365 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-aa93f93f-065f-463e-9ad4-a15653a4e3a0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:02.098168 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-aa93f93f-065f-463e-9ad4-a15653a4e3a0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:02.098619 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-aa93f93f-065f-463e-9ad4-a15653a4e3a0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:02.099411 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-aa93f93f-065f-463e-9ad4-a15653a4e3a0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:02.099849 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-aa93f93f-065f-463e-9ad4-a15653a4e3a0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:02.192535 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-401d2241-2a37-4971-a83c-3f1b1dfd19fa tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:02.193830 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-401d2241-2a37-4971-a83c-3f1b1dfd19fa tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:02.200450 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-401d2241-2a37-4971-a83c-3f1b1dfd19fa tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:02.200974 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-401d2241-2a37-4971-a83c-3f1b1dfd19fa tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:02.201832 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-401d2241-2a37-4971-a83c-3f1b1dfd19fa tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:02.202358 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-401d2241-2a37-4971-a83c-3f1b1dfd19fa tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:02.240649 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-aa93f93f-065f-463e-9ad4-a15653a4e3a0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:02.248888 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-aa93f93f-065f-463e-9ad4-a15653a4e3a0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44" status: 200 len: 1362 microversion: 2.1 time: 0.163910 May 25 16:26:02.249451 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 327/659] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:02 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:26:02.254115 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-3c342ecb-1548-4eb6-a57b-6a0549ba8713 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:02.254712 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-3c342ecb-1548-4eb6-a57b-6a0549ba8713 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:02.261942 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3c342ecb-1548-4eb6-a57b-6a0549ba8713 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:02.262744 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3c342ecb-1548-4eb6-a57b-6a0549ba8713 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:02.263526 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3c342ecb-1548-4eb6-a57b-6a0549ba8713 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:02.263961 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3c342ecb-1548-4eb6-a57b-6a0549ba8713 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:02.279353 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-401d2241-2a37-4971-a83c-3f1b1dfd19fa tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:02.287601 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-401d2241-2a37-4971-a83c-3f1b1dfd19fa tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5" status: 200 len: 1294 microversion: 2.1 time: 0.098897 May 25 16:26:02.298305 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 333/660] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:02 2022] GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 => generated 1294 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:26:02.302436 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3c342ecb-1548-4eb6-a57b-6a0549ba8713 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:02.302886 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3c342ecb-1548-4eb6-a57b-6a0549ba8713 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:02.303326 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.objects.instance [None req-3c342ecb-1548-4eb6-a57b-6a0549ba8713 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lazy-loading 'fault' on Instance uuid 756c834d-49bb-4cd7-b5c7-7140c66b0d0c {{(pid=117510) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:26:02.352663 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-3c342ecb-1548-4eb6-a57b-6a0549ba8713 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:02.361504 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-3c342ecb-1548-4eb6-a57b-6a0549ba8713 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 200 len: 1311 microversion: 2.1 time: 0.110976 May 25 16:26:02.362235 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 328/661] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:02 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 1311 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:26:02.993812 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-e4a142c1-35c1-4f96-9f11-5cbb73e639f6 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:02.994419 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-e4a142c1-35c1-4f96-9f11-5cbb73e639f6 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:03.001234 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e4a142c1-35c1-4f96-9f11-5cbb73e639f6 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:03.001676 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e4a142c1-35c1-4f96-9f11-5cbb73e639f6 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:03.002469 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e4a142c1-35c1-4f96-9f11-5cbb73e639f6 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:03.002900 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e4a142c1-35c1-4f96-9f11-5cbb73e639f6 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:03.028021 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-371c34d6-5a3a-4983-a4a0-3fbe8d5daac9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:26:03.028558 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-371c34d6-5a3a-4983-a4a0-3fbe8d5daac9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:03.034585 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-371c34d6-5a3a-4983-a4a0-3fbe8d5daac9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:03.035037 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-371c34d6-5a3a-4983-a4a0-3fbe8d5daac9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:03.035837 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-371c34d6-5a3a-4983-a4a0-3fbe8d5daac9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:03.036289 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-371c34d6-5a3a-4983-a4a0-3fbe8d5daac9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:03.059894 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.objects.instance [None req-371c34d6-5a3a-4983-a4a0-3fbe8d5daac9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lazy-loading 'flavor' on Instance uuid 7652df85-9116-41c0-b1a1-32a070414bd8 {{(pid=117510) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:26:03.091247 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:26:03.150105 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-e4a142c1-35c1-4f96-9f11-5cbb73e639f6 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:03.160606 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-e4a142c1-35c1-4f96-9f11-5cbb73e639f6 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c" status: 200 len: 1266 microversion: 2.1 time: 0.170525 May 25 16:26:03.162015 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 334/662] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:02 2022] GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:26:03.266437 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-e38cca2d-ac77-4c08-9d4d-f4762a0978a2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:03.267040 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-e38cca2d-ac77-4c08-9d4d-f4762a0978a2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:03.273494 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e38cca2d-ac77-4c08-9d4d-f4762a0978a2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:03.273910 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e38cca2d-ac77-4c08-9d4d-f4762a0978a2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:03.274671 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e38cca2d-ac77-4c08-9d4d-f4762a0978a2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:03.275082 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e38cca2d-ac77-4c08-9d4d-f4762a0978a2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:03.345884 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-371c34d6-5a3a-4983-a4a0-3fbe8d5daac9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "POST /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8/action" status: 202 len: 0 microversion: 2.20 time: 0.321752 May 25 16:26:03.349282 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 329/663] 10.222.0.42 () {62 vars in 1318 bytes} [Wed May 25 16:26:03 2022] POST /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 25 16:26:03.351404 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-913f4a83-a6cc-475d-b287-17adff2927dd tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:03.352110 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-913f4a83-a6cc-475d-b287-17adff2927dd tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:03.358994 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-913f4a83-a6cc-475d-b287-17adff2927dd tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:03.359557 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-913f4a83-a6cc-475d-b287-17adff2927dd tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:03.360401 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-913f4a83-a6cc-475d-b287-17adff2927dd tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:03.360840 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-913f4a83-a6cc-475d-b287-17adff2927dd tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:03.432202 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-913f4a83-a6cc-475d-b287-17adff2927dd tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:03.438515 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-e38cca2d-ac77-4c08-9d4d-f4762a0978a2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:03.440882 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-913f4a83-a6cc-475d-b287-17adff2927dd tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5" status: 200 len: 1294 microversion: 2.1 time: 0.093188 May 25 16:26:03.441456 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 330/664] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:03 2022] GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 => generated 1294 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:26:03.445946 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-1f98dc14-b514-4ec1-9724-e585653258d2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:03.446500 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-e38cca2d-ac77-4c08-9d4d-f4762a0978a2 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44" status: 200 len: 1549 microversion: 2.1 time: 0.184071 May 25 16:26:03.446618 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-1f98dc14-b514-4ec1-9724-e585653258d2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:03.447058 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 335/665] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:03 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44 => generated 1549 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:26:03.452127 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-27811e27-8698-4e89-a21f-f533741f3ee3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:03.452728 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-27811e27-8698-4e89-a21f-f533741f3ee3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 756c834d-49bb-4cd7-b5c7-7140c66b0d0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:03.453019 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1f98dc14-b514-4ec1-9724-e585653258d2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:03.453464 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1f98dc14-b514-4ec1-9724-e585653258d2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:03.454321 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1f98dc14-b514-4ec1-9724-e585653258d2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:03.454666 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1f98dc14-b514-4ec1-9724-e585653258d2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:03.458967 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-27811e27-8698-4e89-a21f-f533741f3ee3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:03.459481 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-27811e27-8698-4e89-a21f-f533741f3ee3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:03.460276 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-27811e27-8698-4e89-a21f-f533741f3ee3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:03.460711 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-27811e27-8698-4e89-a21f-f533741f3ee3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:03.474002 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.wsgi [None req-27811e27-8698-4e89-a21f-f533741f3ee3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] HTTP exception thrown: Instance 756c834d-49bb-4cd7-b5c7-7140c66b0d0c could not be found. May 25 16:26:03.475643 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-27811e27-8698-4e89-a21f-f533741f3ee3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Request method failure captured: May 25 16:26:03.475643 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c HTTP/1.1 May 25 16:26:03.475643 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:26:03.475643 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:26:03.475643 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:26:03.475643 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 0 May 25 16:26:03.475643 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:26:03.475643 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:26:03.475643 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:26:03.475643 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:26:03.475643 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijldYEk-vXf1RzTAhtuBmZCP64e-jFGtt4_4AUU4JvgXjFozEXheYHuLBoLnaDKX2hw8HHhJRSLtnCpwINlrLr_XZWKytjwNPB5nW99kaEc4sI4nUx8x4Ptx9q5FVs8jmBgiEaPPAaP7XvfqFLdfWYv34Y_gMy5FtTHmgzN_RasZUKJo May 25 16:26:03.475643 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:26:03.475643 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:26:03.475643 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:26:03.475643 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:26:03.475643 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:26:03.475643 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:26:03.475643 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: 95d1e25b20a146c198dfeda0dc43cd72 May 25 16:26:03.475643 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1964636607 May 25 16:26:03.475643 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:26:03.475643 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:26:03.477225 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/95d1e25b20a146c198dfeda0dc43cd72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/95d1e25b20a146c198dfeda0dc43cd72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_95d1e25b20a146c198dfeda0dc43cd72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/95d1e25b20a146c198dfeda0dc43cd72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:26:03.477225 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1964636607 May 25 16:26:03.477225 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: 95d1e25b20a146c198dfeda0dc43cd72 May 25 16:26:03.477225 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1964636607 May 25 16:26:03.477225 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-ServerRescueNegativeTestJSON-1964636607-project May 25 16:26:03.477225 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:26:03.477225 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:26:03.477225 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: 30de794b71b343289491531dfbe37f53 May 25 16:26:03.477225 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1964636607-project May 25 16:26:03.477225 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: > May 25 16:26:03.477225 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Instance 756c834d-49bb-4cd7-b5c7-7140c66b0d0c could not be found. May 25 16:26:03.477225 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'id': '756c834d-49bb-4cd7-b5c7-7140c66b0d0c'} May 25 16:26:03.478188 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:26:03.478188 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:26:03.478188 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:26:03.478188 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:26:03.478188 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:26:03.478188 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:26:03.478188 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:26:03.478188 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:26:03.478188 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:26:03.478188 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:26:03.478188 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 756c834d-49bb-4cd7-b5c7-7140c66b0d0c could not be found. May 25 16:26:03.478188 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:26:03.478188 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:26:03.478188 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:26:03.478188 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:26:03.478188 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:26:03.478188 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:26:03.478188 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:26:03.478188 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:26:03.478188 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:26:03.479415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:26:03.479415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:26:03.479415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:26:03.479415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:26:03.479415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:26:03.479415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:26:03.479415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:26:03.479415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 756c834d-49bb-4cd7-b5c7-7140c66b0d0c could not be found. May 25 16:26:03.479415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:26:03.479415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:26:03.479415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:26:03.479415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:26:03.479415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:26:03.479415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:26:03.479415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:26:03.479415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:26:03.479415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 756c834d-49bb-4cd7-b5c7-7140c66b0d0c could not be found. May 25 16:26:03.479415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:26:03.482267 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-27811e27-8698-4e89-a21f-f533741f3ee3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Returning 404 to user: Instance 756c834d-49bb-4cd7-b5c7-7140c66b0d0c could not be found. {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:26:03.482267 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-27811e27-8698-4e89-a21f-f533741f3ee3 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c" status: 404 len: 111 microversion: 2.1 time: 0.028847 May 25 16:26:03.482267 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 336/666] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:03 2022] GET /compute/v2.1/servers/756c834d-49bb-4cd7-b5c7-7140c66b0d0c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:26:03.483070 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-90e4e110-28d2-4bab-a844-a23f41266a06 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:03.483560 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-90e4e110-28d2-4bab-a844-a23f41266a06 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:03.489325 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-90e4e110-28d2-4bab-a844-a23f41266a06 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:03.489808 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-90e4e110-28d2-4bab-a844-a23f41266a06 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:03.490574 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-90e4e110-28d2-4bab-a844-a23f41266a06 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:03.491009 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-90e4e110-28d2-4bab-a844-a23f41266a06 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:03.494723 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:26:03.596730 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-90e4e110-28d2-4bab-a844-a23f41266a06 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.117821 May 25 16:26:03.598936 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 337/667] 10.222.0.42 () {58 vars in 1274 bytes} [Wed May 25 16:26:03 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:26:03.601968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-5eea6451-5d8c-48d7-bfda-63a3480e5615 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:03.602457 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-5eea6451-5d8c-48d7-bfda-63a3480e5615 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:03.609588 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5eea6451-5d8c-48d7-bfda-63a3480e5615 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:03.610071 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5eea6451-5d8c-48d7-bfda-63a3480e5615 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:03.610839 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5eea6451-5d8c-48d7-bfda-63a3480e5615 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:03.611270 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5eea6451-5d8c-48d7-bfda-63a3480e5615 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:03.627536 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-1f98dc14-b514-4ec1-9724-e585653258d2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:03.635932 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-1f98dc14-b514-4ec1-9724-e585653258d2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:03.636445 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-5eea6451-5d8c-48d7-bfda-63a3480e5615 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Going to try to terminate instance {{(pid=117509) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:26:03.637775 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-1f98dc14-b514-4ec1-9724-e585653258d2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:03.639029 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-1f98dc14-b514-4ec1-9724-e585653258d2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1724 microversion: 2.20 time: 0.196619 May 25 16:26:03.640063 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 331/668] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:03 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:03.720163 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-5eea6451-5d8c-48d7-bfda-63a3480e5615 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "DELETE /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 204 len: 0 microversion: 2.1 time: 0.121503 May 25 16:26:03.720759 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 338/669] 10.222.0.42 () {58 vars in 1238 bytes} [Wed May 25 16:26:03 2022] DELETE /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:26:03.731786 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-3c7720de-e796-47bf-9370-7daa69666570 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:03.732498 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-3c7720de-e796-47bf-9370-7daa69666570 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:03.741933 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3c7720de-e796-47bf-9370-7daa69666570 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:03.743904 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3c7720de-e796-47bf-9370-7daa69666570 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:03.745056 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3c7720de-e796-47bf-9370-7daa69666570 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:03.746426 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3c7720de-e796-47bf-9370-7daa69666570 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:03.887881 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-3c7720de-e796-47bf-9370-7daa69666570 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:03.895567 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-3c7720de-e796-47bf-9370-7daa69666570 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1520 microversion: 2.1 time: 0.170008 May 25 16:26:03.896144 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 332/670] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:03 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:26:04.178636 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-610466d1-eb1d-45f5-817e-51fac32fda5a tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:04.179238 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-610466d1-eb1d-45f5-817e-51fac32fda5a tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:04.185358 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-610466d1-eb1d-45f5-817e-51fac32fda5a tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:04.185836 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-610466d1-eb1d-45f5-817e-51fac32fda5a tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:04.186593 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-610466d1-eb1d-45f5-817e-51fac32fda5a tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:04.187022 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-610466d1-eb1d-45f5-817e-51fac32fda5a tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:04.323248 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-610466d1-eb1d-45f5-817e-51fac32fda5a tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:04.333599 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-610466d1-eb1d-45f5-817e-51fac32fda5a tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c" status: 200 len: 1266 microversion: 2.1 time: 0.159222 May 25 16:26:04.334208 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 339/671] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:04 2022] GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:26:04.458133 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-307f160f-119d-4cae-ae9a-3185a452e376 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:04.458747 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-307f160f-119d-4cae-ae9a-3185a452e376 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:04.465253 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-307f160f-119d-4cae-ae9a-3185a452e376 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:04.465708 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-307f160f-119d-4cae-ae9a-3185a452e376 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:04.466634 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-307f160f-119d-4cae-ae9a-3185a452e376 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:04.466994 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-307f160f-119d-4cae-ae9a-3185a452e376 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:04.537537 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-307f160f-119d-4cae-ae9a-3185a452e376 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:04.558728 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-307f160f-119d-4cae-ae9a-3185a452e376 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5" status: 200 len: 1302 microversion: 2.1 time: 0.104006 May 25 16:26:04.567559 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 333/672] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:04 2022] GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 => generated 1302 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:26:04.582413 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-93b36205-ac0e-4100-b5e1-79bf6489c9b3 req-851867dc-6faa-4feb-8f4f-2373be765a11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50c1e1a5-ce7f-4032-b028-431051dfde44", "tag": "a3612e40-f8ea-4391-b684-977f3fa2cfff"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:26:04.590904 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-93b36205-ac0e-4100-b5e1-79bf6489c9b3 req-851867dc-6faa-4feb-8f4f-2373be765a11 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:04.591343 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-93b36205-ac0e-4100-b5e1-79bf6489c9b3 req-851867dc-6faa-4feb-8f4f-2373be765a11 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:04.602218 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-93b36205-ac0e-4100-b5e1-79bf6489c9b3 req-851867dc-6faa-4feb-8f4f-2373be765a11 service nova] Creating event network-changed:a3612e40-f8ea-4391-b684-977f3fa2cfff for instance 50c1e1a5-ce7f-4032-b028-431051dfde44 on hv-cinder-84327 May 25 16:26:04.607277 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-93b36205-ac0e-4100-b5e1-79bf6489c9b3 req-851867dc-6faa-4feb-8f4f-2373be765a11 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028544 May 25 16:26:04.607880 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 340/673] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:26:04.657425 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-3de7d561-a2eb-44b5-9069-be33ecd74785 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:04.658036 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-3de7d561-a2eb-44b5-9069-be33ecd74785 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:04.664287 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3de7d561-a2eb-44b5-9069-be33ecd74785 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:04.664742 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3de7d561-a2eb-44b5-9069-be33ecd74785 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:04.665512 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3de7d561-a2eb-44b5-9069-be33ecd74785 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:04.666009 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3de7d561-a2eb-44b5-9069-be33ecd74785 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:04.804656 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-3de7d561-a2eb-44b5-9069-be33ecd74785 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:04.813700 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-3de7d561-a2eb-44b5-9069-be33ecd74785 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:04.815247 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-3de7d561-a2eb-44b5-9069-be33ecd74785 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:04.816455 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-3de7d561-a2eb-44b5-9069-be33ecd74785 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1724 microversion: 2.20 time: 0.162907 May 25 16:26:04.817237 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 334/674] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:04 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:04.913734 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-60359e63-1ea1-494b-af4d-4d32c0aca705 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:04.914433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-60359e63-1ea1-494b-af4d-4d32c0aca705 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:04.917979 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:26:04.922585 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-60359e63-1ea1-494b-af4d-4d32c0aca705 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:04.923036 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-60359e63-1ea1-494b-af4d-4d32c0aca705 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:04.923789 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-60359e63-1ea1-494b-af4d-4d32c0aca705 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:04.924222 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-60359e63-1ea1-494b-af4d-4d32c0aca705 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:05.063657 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-60359e63-1ea1-494b-af4d-4d32c0aca705 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:05.071112 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-60359e63-1ea1-494b-af4d-4d32c0aca705 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1520 microversion: 2.1 time: 0.161899 May 25 16:26:05.071745 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 341/675] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:04 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:26:05.351471 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-e9707b98-2652-4b6f-a5a9-d8f89c47d876 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:05.352168 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-e9707b98-2652-4b6f-a5a9-d8f89c47d876 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:05.358900 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e9707b98-2652-4b6f-a5a9-d8f89c47d876 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:05.359354 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e9707b98-2652-4b6f-a5a9-d8f89c47d876 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:05.360118 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e9707b98-2652-4b6f-a5a9-d8f89c47d876 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:05.360557 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e9707b98-2652-4b6f-a5a9-d8f89c47d876 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:05.501698 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-e9707b98-2652-4b6f-a5a9-d8f89c47d876 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:05.509589 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-e9707b98-2652-4b6f-a5a9-d8f89c47d876 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c" status: 200 len: 1266 microversion: 2.1 time: 0.161967 May 25 16:26:05.510176 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 335/676] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:05 2022] GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:26:05.576663 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-4fcafb35-db82-4838-a739-c26deebb66b3 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:05.577271 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-4fcafb35-db82-4838-a739-c26deebb66b3 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:05.583506 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4fcafb35-db82-4838-a739-c26deebb66b3 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:05.583971 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4fcafb35-db82-4838-a739-c26deebb66b3 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:05.584746 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4fcafb35-db82-4838-a739-c26deebb66b3 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:05.585176 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4fcafb35-db82-4838-a739-c26deebb66b3 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:05.835974 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-34415743-f28a-494a-8862-c08cffdabd87 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:05.836582 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-34415743-f28a-494a-8862-c08cffdabd87 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:05.843053 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-34415743-f28a-494a-8862-c08cffdabd87 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:05.843501 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-34415743-f28a-494a-8862-c08cffdabd87 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:05.844268 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-34415743-f28a-494a-8862-c08cffdabd87 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:05.844706 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-34415743-f28a-494a-8862-c08cffdabd87 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:05.893732 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-4fcafb35-db82-4838-a739-c26deebb66b3 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:05.901295 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-4fcafb35-db82-4838-a739-c26deebb66b3 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5" status: 200 len: 1302 microversion: 2.1 time: 0.329232 May 25 16:26:05.902076 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 342/677] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:05 2022] GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 => generated 1302 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:26:05.986324 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-34415743-f28a-494a-8862-c08cffdabd87 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:05.994559 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-34415743-f28a-494a-8862-c08cffdabd87 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:05.996419 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-34415743-f28a-494a-8862-c08cffdabd87 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:05.997575 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-34415743-f28a-494a-8862-c08cffdabd87 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1724 microversion: 2.20 time: 0.165518 May 25 16:26:05.998155 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 336/678] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:05 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:26:06.087721 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-3bc28e82-0563-4f2d-9c44-dfc373ceaf8f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:06.088356 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-3bc28e82-0563-4f2d-9c44-dfc373ceaf8f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:06.094916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3bc28e82-0563-4f2d-9c44-dfc373ceaf8f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:06.095404 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3bc28e82-0563-4f2d-9c44-dfc373ceaf8f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:06.096114 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3bc28e82-0563-4f2d-9c44-dfc373ceaf8f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:06.096549 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3bc28e82-0563-4f2d-9c44-dfc373ceaf8f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:06.237794 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-3bc28e82-0563-4f2d-9c44-dfc373ceaf8f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:06.246246 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-3bc28e82-0563-4f2d-9c44-dfc373ceaf8f tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1520 microversion: 2.1 time: 0.161667 May 25 16:26:06.246819 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 343/679] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:06 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:26:06.528613 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-1b642d73-7c03-4176-896a-fe50a7325814 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:06.529348 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-1b642d73-7c03-4176-896a-fe50a7325814 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:06.536121 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1b642d73-7c03-4176-896a-fe50a7325814 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:06.536814 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1b642d73-7c03-4176-896a-fe50a7325814 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:06.537582 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1b642d73-7c03-4176-896a-fe50a7325814 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:06.538171 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1b642d73-7c03-4176-896a-fe50a7325814 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:06.672968 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-1b642d73-7c03-4176-896a-fe50a7325814 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:06.680366 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-1b642d73-7c03-4176-896a-fe50a7325814 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c" status: 200 len: 1266 microversion: 2.1 time: 0.156696 May 25 16:26:06.680996 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 337/680] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:06 2022] GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:26:06.919265 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-b6938b5b-f31b-4e2c-ac63-cbc2fc93bed9 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:06.919913 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-b6938b5b-f31b-4e2c-ac63-cbc2fc93bed9 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:06.926631 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b6938b5b-f31b-4e2c-ac63-cbc2fc93bed9 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:06.927067 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b6938b5b-f31b-4e2c-ac63-cbc2fc93bed9 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:06.927820 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b6938b5b-f31b-4e2c-ac63-cbc2fc93bed9 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:06.928242 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b6938b5b-f31b-4e2c-ac63-cbc2fc93bed9 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:06.992201 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-b6938b5b-f31b-4e2c-ac63-cbc2fc93bed9 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:06.999657 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-b6938b5b-f31b-4e2c-ac63-cbc2fc93bed9 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5" status: 200 len: 1312 microversion: 2.1 time: 0.085628 May 25 16:26:07.000219 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 344/681] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:06 2022] GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 => generated 1312 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:26:07.015934 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-39b516f3-57c5-4c2a-9419-9db56439fd9f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:07.016603 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-39b516f3-57c5-4c2a-9419-9db56439fd9f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:07.022618 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-39b516f3-57c5-4c2a-9419-9db56439fd9f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:07.023068 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-39b516f3-57c5-4c2a-9419-9db56439fd9f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:07.023833 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-39b516f3-57c5-4c2a-9419-9db56439fd9f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:07.024272 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-39b516f3-57c5-4c2a-9419-9db56439fd9f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:07.160760 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-39b516f3-57c5-4c2a-9419-9db56439fd9f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:07.169489 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-39b516f3-57c5-4c2a-9419-9db56439fd9f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:07.171042 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-39b516f3-57c5-4c2a-9419-9db56439fd9f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:07.172135 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-39b516f3-57c5-4c2a-9419-9db56439fd9f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1724 microversion: 2.20 time: 0.160285 May 25 16:26:07.172800 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 338/682] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:07 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:07.264318 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-0159bbe4-563a-4c38-b7c0-079f57e4b383 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:07.264916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-0159bbe4-563a-4c38-b7c0-079f57e4b383 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:07.270938 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0159bbe4-563a-4c38-b7c0-079f57e4b383 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:07.271692 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0159bbe4-563a-4c38-b7c0-079f57e4b383 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:07.272129 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0159bbe4-563a-4c38-b7c0-079f57e4b383 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:07.272663 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0159bbe4-563a-4c38-b7c0-079f57e4b383 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:07.503374 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-0159bbe4-563a-4c38-b7c0-079f57e4b383 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30de794b71b343289491531dfbe37f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1e25b20a146c198dfeda0dc43cd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:07.513145 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-0159bbe4-563a-4c38-b7c0-079f57e4b383 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 200 len: 1520 microversion: 2.1 time: 0.252870 May 25 16:26:07.513954 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 345/683] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:07 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:26:07.699161 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-01270e32-7547-4b30-baeb-76c9e88fa255 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:07.699781 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-01270e32-7547-4b30-baeb-76c9e88fa255 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:07.737557 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-01270e32-7547-4b30-baeb-76c9e88fa255 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:07.739085 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-01270e32-7547-4b30-baeb-76c9e88fa255 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:07.741508 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-01270e32-7547-4b30-baeb-76c9e88fa255 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:07.742749 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-01270e32-7547-4b30-baeb-76c9e88fa255 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:07.786807 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-316c9bc0-a8cd-4510-8f56-9363549a8dac req-8725318a-c0fe-4b51-90eb-14ae02eba5ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f324c4-3a3e-4e8d-b2ca-91493fae47b1", "name": "network-vif-deleted", "tag": "b95684f0-92c8-457d-bd07-c98d017be6fc"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:26:07.797198 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-316c9bc0-a8cd-4510-8f56-9363549a8dac req-8725318a-c0fe-4b51-90eb-14ae02eba5ee service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:07.798821 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-316c9bc0-a8cd-4510-8f56-9363549a8dac req-8725318a-c0fe-4b51-90eb-14ae02eba5ee service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:07.840622 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-316c9bc0-a8cd-4510-8f56-9363549a8dac req-8725318a-c0fe-4b51-90eb-14ae02eba5ee service nova] Creating event network-vif-deleted:b95684f0-92c8-457d-bd07-c98d017be6fc for instance 68f324c4-3a3e-4e8d-b2ca-91493fae47b1 on hv-cinder-84327 May 25 16:26:07.846326 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-316c9bc0-a8cd-4510-8f56-9363549a8dac req-8725318a-c0fe-4b51-90eb-14ae02eba5ee service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063237 May 25 16:26:07.847586 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 346/684] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:26:07.919675 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-01270e32-7547-4b30-baeb-76c9e88fa255 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:07.929619 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-01270e32-7547-4b30-baeb-76c9e88fa255 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c" status: 200 len: 1266 microversion: 2.1 time: 0.236759 May 25 16:26:07.930240 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 339/685] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:07 2022] GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:26:08.017595 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-d7e6e3a7-4c43-4db6-a2b3-72727e1756c6 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:08.018240 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-d7e6e3a7-4c43-4db6-a2b3-72727e1756c6 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:08.025030 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d7e6e3a7-4c43-4db6-a2b3-72727e1756c6 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:08.025498 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d7e6e3a7-4c43-4db6-a2b3-72727e1756c6 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:08.026335 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d7e6e3a7-4c43-4db6-a2b3-72727e1756c6 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:08.027813 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d7e6e3a7-4c43-4db6-a2b3-72727e1756c6 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:08.099184 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-d7e6e3a7-4c43-4db6-a2b3-72727e1756c6 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:08.109544 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-d7e6e3a7-4c43-4db6-a2b3-72727e1756c6 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5" status: 200 len: 1300 microversion: 2.1 time: 0.096394 May 25 16:26:08.121895 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 347/686] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:08 2022] GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 => generated 1300 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:26:08.208251 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-a69ec7b3-8bbe-4176-807d-63ea23508db2 req-0baa67de-2613-4c71-abf2-e61de90396e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5ebfa48-d140-464a-8556-590a2666ce0c", "name": "network-vif-plugged", "status": "completed", "tag": "414a4851-4f1f-4eac-9236-89ed850b9b5a"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:26:08.213682 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-39a80933-3988-47ae-8d39-2fc8eab5e696 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:08.219364 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-39a80933-3988-47ae-8d39-2fc8eab5e696 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:08.272360 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-39a80933-3988-47ae-8d39-2fc8eab5e696 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:08.275152 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-a69ec7b3-8bbe-4176-807d-63ea23508db2 req-0baa67de-2613-4c71-abf2-e61de90396e6 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:08.275601 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-a69ec7b3-8bbe-4176-807d-63ea23508db2 req-0baa67de-2613-4c71-abf2-e61de90396e6 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:08.281453 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-39a80933-3988-47ae-8d39-2fc8eab5e696 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:08.284672 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-39a80933-3988-47ae-8d39-2fc8eab5e696 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:08.285316 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-39a80933-3988-47ae-8d39-2fc8eab5e696 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:08.323645 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-a69ec7b3-8bbe-4176-807d-63ea23508db2 req-0baa67de-2613-4c71-abf2-e61de90396e6 service nova] Creating event network-vif-plugged:414a4851-4f1f-4eac-9236-89ed850b9b5a for instance b5ebfa48-d140-464a-8556-590a2666ce0c on hv-cinder-84327 May 25 16:26:08.338654 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-a69ec7b3-8bbe-4176-807d-63ea23508db2 req-0baa67de-2613-4c71-abf2-e61de90396e6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131779 May 25 16:26:08.342909 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 348/687] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:26:08.498720 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-39a80933-3988-47ae-8d39-2fc8eab5e696 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:08.508254 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-39a80933-3988-47ae-8d39-2fc8eab5e696 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:08.512604 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-39a80933-3988-47ae-8d39-2fc8eab5e696 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:08.515401 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-39a80933-3988-47ae-8d39-2fc8eab5e696 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1724 microversion: 2.20 time: 0.324762 May 25 16:26:08.516413 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 340/688] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:08 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1724 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:08.532152 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-a10efa07-561e-4471-bc1b-0483d93db1c7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:08.532754 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-a10efa07-561e-4471-bc1b-0483d93db1c7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] [instance: 68f324c4-3a3e-4e8d-b2ca-91493fae47b1] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:08.540091 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a10efa07-561e-4471-bc1b-0483d93db1c7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:08.540535 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a10efa07-561e-4471-bc1b-0483d93db1c7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:08.541357 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a10efa07-561e-4471-bc1b-0483d93db1c7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:08.542352 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a10efa07-561e-4471-bc1b-0483d93db1c7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:08.563544 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.wsgi [None req-a10efa07-561e-4471-bc1b-0483d93db1c7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] HTTP exception thrown: Instance 68f324c4-3a3e-4e8d-b2ca-91493fae47b1 could not be found. May 25 16:26:08.566195 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-a10efa07-561e-4471-bc1b-0483d93db1c7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Request method failure captured: May 25 16:26:08.566195 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 HTTP/1.1 May 25 16:26:08.566195 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:26:08.566195 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:26:08.566195 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:26:08.566195 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 0 May 25 16:26:08.566195 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:26:08.566195 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:26:08.566195 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:26:08.566195 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:26:08.566195 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijldYEk-vXf1RzTAhtuBmZCP64e-jFGtt4_4AUU4JvgXjFozEXheYHuLBoLnaDKX2hw8HHhJRSLtnCpwINlrLr_XZWKytjwNPB5nW99kaEc4sI4nUx8x4Ptx9q5FVs8jmBgiEaPPAaP7XvfqFLdfWYv34Y_gMy5FtTHmgzN_RasZUKJo May 25 16:26:08.566195 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:26:08.566195 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:26:08.566195 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:26:08.566195 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:26:08.566195 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:26:08.566195 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:26:08.566195 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: 95d1e25b20a146c198dfeda0dc43cd72 May 25 16:26:08.566195 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1964636607 May 25 16:26:08.566195 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:26:08.566195 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:26:08.567750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/95d1e25b20a146c198dfeda0dc43cd72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/95d1e25b20a146c198dfeda0dc43cd72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_95d1e25b20a146c198dfeda0dc43cd72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/95d1e25b20a146c198dfeda0dc43cd72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:26:08.567750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1964636607 May 25 16:26:08.567750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: 95d1e25b20a146c198dfeda0dc43cd72 May 25 16:26:08.567750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1964636607 May 25 16:26:08.567750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-ServerRescueNegativeTestJSON-1964636607-project May 25 16:26:08.567750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:26:08.567750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:26:08.567750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: 30de794b71b343289491531dfbe37f53 May 25 16:26:08.567750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1964636607-project May 25 16:26:08.567750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: > May 25 16:26:08.567750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Instance 68f324c4-3a3e-4e8d-b2ca-91493fae47b1 could not be found. May 25 16:26:08.567750 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'id': '68f324c4-3a3e-4e8d-b2ca-91493fae47b1'} May 25 16:26:08.568581 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:26:08.568581 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:26:08.568581 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:26:08.568581 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:26:08.568581 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:26:08.568581 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:26:08.568581 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:26:08.568581 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:26:08.568581 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:26:08.568581 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:26:08.568581 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68f324c4-3a3e-4e8d-b2ca-91493fae47b1 could not be found. May 25 16:26:08.568581 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:26:08.568581 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:26:08.568581 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:26:08.568581 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:26:08.568581 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:26:08.568581 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:26:08.568581 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:26:08.568581 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:26:08.568581 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:26:08.570006 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:26:08.570006 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:26:08.570006 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:26:08.570006 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:26:08.570006 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:26:08.570006 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:26:08.570006 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:26:08.570006 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68f324c4-3a3e-4e8d-b2ca-91493fae47b1 could not be found. May 25 16:26:08.570006 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:26:08.570006 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:26:08.570006 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:26:08.570006 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:26:08.570006 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:26:08.570006 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:26:08.570006 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:26:08.570006 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:26:08.570006 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68f324c4-3a3e-4e8d-b2ca-91493fae47b1 could not be found. May 25 16:26:08.570006 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:26:08.571281 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-a10efa07-561e-4471-bc1b-0483d93db1c7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] Returning 404 to user: Instance 68f324c4-3a3e-4e8d-b2ca-91493fae47b1 could not be found. {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:26:08.571281 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-a10efa07-561e-4471-bc1b-0483d93db1c7 tempest-ServerRescueNegativeTestJSON-1964636607 tempest-ServerRescueNegativeTestJSON-1964636607-project] 10.222.0.42 "GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1" status: 404 len: 111 microversion: 2.1 time: 0.041631 May 25 16:26:08.571281 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 349/689] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:08 2022] GET /compute/v2.1/servers/68f324c4-3a3e-4e8d-b2ca-91493fae47b1 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:26:08.947956 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-450388a2-2f5a-4d8c-a373-fba259e4823b tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:08.949259 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-450388a2-2f5a-4d8c-a373-fba259e4823b tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:08.956030 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-450388a2-2f5a-4d8c-a373-fba259e4823b tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:08.956591 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-450388a2-2f5a-4d8c-a373-fba259e4823b tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:08.957466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-450388a2-2f5a-4d8c-a373-fba259e4823b tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:08.958062 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-450388a2-2f5a-4d8c-a373-fba259e4823b tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:09.132862 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-ddc6ad73-0824-45c3-bbe0-24da29e38672 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:09.133478 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-ddc6ad73-0824-45c3-bbe0-24da29e38672 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:09.142500 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ddc6ad73-0824-45c3-bbe0-24da29e38672 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:09.142948 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ddc6ad73-0824-45c3-bbe0-24da29e38672 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:09.143940 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ddc6ad73-0824-45c3-bbe0-24da29e38672 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:09.144535 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ddc6ad73-0824-45c3-bbe0-24da29e38672 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:09.262600 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-450388a2-2f5a-4d8c-a373-fba259e4823b tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:09.270348 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-450388a2-2f5a-4d8c-a373-fba259e4823b tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c" status: 200 len: 1266 microversion: 2.1 time: 0.326320 May 25 16:26:09.280390 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 341/690] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:08 2022] GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c => generated 1266 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:26:09.280390 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-300c58be-2348-4d25-9928-09db2389c494 req-f986955b-aaf6-47bb-b5fd-9bb9db248b41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "964d7f7e-8562-42f6-80c3-cd7d03c3f1c5", "tag": "dd94e749-35a1-4f34-8ff6-eddc3aa70245"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:26:09.290214 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-300c58be-2348-4d25-9928-09db2389c494 req-f986955b-aaf6-47bb-b5fd-9bb9db248b41 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:09.290667 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-300c58be-2348-4d25-9928-09db2389c494 req-f986955b-aaf6-47bb-b5fd-9bb9db248b41 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:09.302768 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-300c58be-2348-4d25-9928-09db2389c494 req-f986955b-aaf6-47bb-b5fd-9bb9db248b41 service nova] Creating event network-changed:dd94e749-35a1-4f34-8ff6-eddc3aa70245 for instance 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 on hv-cinder-84327 May 25 16:26:09.309219 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-300c58be-2348-4d25-9928-09db2389c494 req-f986955b-aaf6-47bb-b5fd-9bb9db248b41 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036175 May 25 16:26:09.310535 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 342/691] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:26:09.483285 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-ddc6ad73-0824-45c3-bbe0-24da29e38672 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:09.491087 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-ddc6ad73-0824-45c3-bbe0-24da29e38672 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5" status: 200 len: 1367 microversion: 2.1 time: 0.365181 May 25 16:26:09.491659 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 350/692] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:09 2022] GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 => generated 1367 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:26:09.538346 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-f684ae75-5900-48fe-8e58-1e2f59ad978b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:09.539625 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-f684ae75-5900-48fe-8e58-1e2f59ad978b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:09.547953 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f684ae75-5900-48fe-8e58-1e2f59ad978b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:09.548719 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f684ae75-5900-48fe-8e58-1e2f59ad978b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:09.549812 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f684ae75-5900-48fe-8e58-1e2f59ad978b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:09.550388 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f684ae75-5900-48fe-8e58-1e2f59ad978b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:09.756922 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-f684ae75-5900-48fe-8e58-1e2f59ad978b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:09.765538 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-f684ae75-5900-48fe-8e58-1e2f59ad978b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:09.768028 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-f684ae75-5900-48fe-8e58-1e2f59ad978b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:09.768514 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-f684ae75-5900-48fe-8e58-1e2f59ad978b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1724 microversion: 2.20 time: 0.235579 May 25 16:26:09.769461 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 343/693] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:09 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:10.290183 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-0c1f02db-cd72-4acc-867b-e971220bf0ed tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:10.290982 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-0c1f02db-cd72-4acc-867b-e971220bf0ed tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:10.298991 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0c1f02db-cd72-4acc-867b-e971220bf0ed tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:10.299546 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0c1f02db-cd72-4acc-867b-e971220bf0ed tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:10.300418 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0c1f02db-cd72-4acc-867b-e971220bf0ed tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:10.300956 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0c1f02db-cd72-4acc-867b-e971220bf0ed tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:10.510162 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-33ba6fd6-daa5-40b6-85ff-f59f04d2749f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:10.510885 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-33ba6fd6-daa5-40b6-85ff-f59f04d2749f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:10.523706 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-33ba6fd6-daa5-40b6-85ff-f59f04d2749f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:10.524327 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-33ba6fd6-daa5-40b6-85ff-f59f04d2749f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:10.526273 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-33ba6fd6-daa5-40b6-85ff-f59f04d2749f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:10.527173 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-33ba6fd6-daa5-40b6-85ff-f59f04d2749f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:10.787501 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-0c1f02db-cd72-4acc-867b-e971220bf0ed tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:10.795732 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-0c1f02db-cd72-4acc-867b-e971220bf0ed tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c" status: 200 len: 1266 microversion: 2.1 time: 0.511531 May 25 16:26:10.796359 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 351/694] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:10 2022] GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c => generated 1266 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:26:10.798927 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-33ba6fd6-daa5-40b6-85ff-f59f04d2749f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:10.801279 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-e158ee32-42e2-4231-bc45-f4432bd0fd66 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:10.801904 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-e158ee32-42e2-4231-bc45-f4432bd0fd66 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:10.806824 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-33ba6fd6-daa5-40b6-85ff-f59f04d2749f tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5" status: 200 len: 1367 microversion: 2.1 time: 0.301820 May 25 16:26:10.807632 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell0:SELECT=2 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:26:10.809954 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e158ee32-42e2-4231-bc45-f4432bd0fd66 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:10.810399 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e158ee32-42e2-4231-bc45-f4432bd0fd66 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:10.811363 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e158ee32-42e2-4231-bc45-f4432bd0fd66 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:10.811805 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e158ee32-42e2-4231-bc45-f4432bd0fd66 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:10.816894 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 344/695] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:10 2022] GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 => generated 1367 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:26:10.832327 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell0:SELECT=10 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:26:11.041577 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-e158ee32-42e2-4231-bc45-f4432bd0fd66 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:11.055210 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-e158ee32-42e2-4231-bc45-f4432bd0fd66 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:11.057316 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-e158ee32-42e2-4231-bc45-f4432bd0fd66 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:11.060557 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-e158ee32-42e2-4231-bc45-f4432bd0fd66 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1724 microversion: 2.20 time: 0.262902 May 25 16:26:11.061242 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 352/696] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:10 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:11.816996 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-516d0f69-5533-487d-8b88-c5dd6c231bad tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:11.820084 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-516d0f69-5533-487d-8b88-c5dd6c231bad tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:11.825238 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-0539a7e0-b86c-451b-9482-0df2521bd759 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:11.826513 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-0539a7e0-b86c-451b-9482-0df2521bd759 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:11.826649 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell0:SELECT=2 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:26:11.829528 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-516d0f69-5533-487d-8b88-c5dd6c231bad tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:11.830470 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-516d0f69-5533-487d-8b88-c5dd6c231bad tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:11.831377 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-516d0f69-5533-487d-8b88-c5dd6c231bad tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:11.832153 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-516d0f69-5533-487d-8b88-c5dd6c231bad tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:11.834312 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0539a7e0-b86c-451b-9482-0df2521bd759 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:11.834762 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0539a7e0-b86c-451b-9482-0df2521bd759 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:11.835541 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0539a7e0-b86c-451b-9482-0df2521bd759 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:11.835969 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0539a7e0-b86c-451b-9482-0df2521bd759 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:12.213238 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-0539a7e0-b86c-451b-9482-0df2521bd759 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:12.217415 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-516d0f69-5533-487d-8b88-c5dd6c231bad tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:12.221123 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:26:12.221932 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-0539a7e0-b86c-451b-9482-0df2521bd759 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5" status: 200 len: 1367 microversion: 2.1 time: 0.401383 May 25 16:26:12.233649 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 353/697] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:11 2022] GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 => generated 1367 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:26:12.233649 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-03e6d5e8-ddba-4245-a983-c23f924e7373 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:12.233649 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-03e6d5e8-ddba-4245-a983-c23f924e7373 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:12.239065 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-03e6d5e8-ddba-4245-a983-c23f924e7373 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:12.239538 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-03e6d5e8-ddba-4245-a983-c23f924e7373 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:12.240298 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-03e6d5e8-ddba-4245-a983-c23f924e7373 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:12.240737 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-03e6d5e8-ddba-4245-a983-c23f924e7373 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:12.246512 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-516d0f69-5533-487d-8b88-c5dd6c231bad tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c" status: 200 len: 1452 microversion: 2.1 time: 0.432880 May 25 16:26:12.248054 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 345/698] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:11 2022] GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c => generated 1452 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:26:12.264762 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-71881fc9-c83c-437d-82c3-2eade5a9839e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:12.265413 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-71881fc9-c83c-437d-82c3-2eade5a9839e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:12.275231 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-71881fc9-c83c-437d-82c3-2eade5a9839e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:12.275687 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-71881fc9-c83c-437d-82c3-2eade5a9839e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:12.276477 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-71881fc9-c83c-437d-82c3-2eade5a9839e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:12.276912 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-71881fc9-c83c-437d-82c3-2eade5a9839e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:12.536033 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-03e6d5e8-ddba-4245-a983-c23f924e7373 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:12.541886 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-71881fc9-c83c-437d-82c3-2eade5a9839e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:12.547710 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-03e6d5e8-ddba-4245-a983-c23f924e7373 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:12.550305 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-03e6d5e8-ddba-4245-a983-c23f924e7373 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:12.552350 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-71881fc9-c83c-437d-82c3-2eade5a9839e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c" status: 200 len: 1452 microversion: 2.1 time: 0.292096 May 25 16:26:12.553432 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 346/699] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:12 2022] GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c => generated 1452 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:26:12.554585 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-03e6d5e8-ddba-4245-a983-c23f924e7373 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1724 microversion: 2.20 time: 0.328166 May 25 16:26:12.555628 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 354/700] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:12 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1724 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:13.240476 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-6257633b-8d76-4b2a-9453-b55fa435e719 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:13.241072 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-6257633b-8d76-4b2a-9453-b55fa435e719 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:13.248692 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6257633b-8d76-4b2a-9453-b55fa435e719 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:13.249214 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6257633b-8d76-4b2a-9453-b55fa435e719 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:13.250256 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6257633b-8d76-4b2a-9453-b55fa435e719 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:13.250759 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-6257633b-8d76-4b2a-9453-b55fa435e719 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:13.473409 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-6257633b-8d76-4b2a-9453-b55fa435e719 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:13.482700 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-6257633b-8d76-4b2a-9453-b55fa435e719 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5" status: 200 len: 1367 microversion: 2.1 time: 0.246145 May 25 16:26:13.483288 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 347/701] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:13 2022] GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:26:13.573036 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-4a92b43f-f059-427c-82e8-0217beac7fc8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:13.574546 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-4a92b43f-f059-427c-82e8-0217beac7fc8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:13.586287 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4a92b43f-f059-427c-82e8-0217beac7fc8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:13.587021 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4a92b43f-f059-427c-82e8-0217beac7fc8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:13.588068 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4a92b43f-f059-427c-82e8-0217beac7fc8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:13.588993 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4a92b43f-f059-427c-82e8-0217beac7fc8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:13.611842 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:26:13.841616 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-4a92b43f-f059-427c-82e8-0217beac7fc8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:13.849624 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-4a92b43f-f059-427c-82e8-0217beac7fc8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:13.851140 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-4a92b43f-f059-427c-82e8-0217beac7fc8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:13.852286 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-4a92b43f-f059-427c-82e8-0217beac7fc8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1724 microversion: 2.20 time: 0.283675 May 25 16:26:13.852828 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 355/702] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:13 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1724 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:14.500008 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-4296deb0-d2f2-43c0-b7c7-f2b21e4550e8 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:14.500653 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-4296deb0-d2f2-43c0-b7c7-f2b21e4550e8 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:14.508155 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4296deb0-d2f2-43c0-b7c7-f2b21e4550e8 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:14.508633 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4296deb0-d2f2-43c0-b7c7-f2b21e4550e8 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:14.509487 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4296deb0-d2f2-43c0-b7c7-f2b21e4550e8 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:14.509940 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4296deb0-d2f2-43c0-b7c7-f2b21e4550e8 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:14.741002 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-4296deb0-d2f2-43c0-b7c7-f2b21e4550e8 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:14.748957 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-4296deb0-d2f2-43c0-b7c7-f2b21e4550e8 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5" status: 200 len: 1367 microversion: 2.1 time: 0.252876 May 25 16:26:14.749543 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 348/703] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:14 2022] GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:26:14.873284 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-9b24402a-ae01-4d26-8dcc-c2369345bda9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:14.874052 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-9b24402a-ae01-4d26-8dcc-c2369345bda9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:14.880358 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9b24402a-ae01-4d26-8dcc-c2369345bda9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:14.880897 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9b24402a-ae01-4d26-8dcc-c2369345bda9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:14.882052 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9b24402a-ae01-4d26-8dcc-c2369345bda9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:14.882573 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9b24402a-ae01-4d26-8dcc-c2369345bda9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:14.992768 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-eab7de1a-a217-4a05-a92a-98fae1e6fc3a req-409d4569-a6de-42df-b438-df871574d52b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5ebfa48-d140-464a-8556-590a2666ce0c", "tag": "414a4851-4f1f-4eac-9236-89ed850b9b5a"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:26:15.005365 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-eab7de1a-a217-4a05-a92a-98fae1e6fc3a req-409d4569-a6de-42df-b438-df871574d52b service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:15.011641 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-eab7de1a-a217-4a05-a92a-98fae1e6fc3a req-409d4569-a6de-42df-b438-df871574d52b service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:15.025081 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-eab7de1a-a217-4a05-a92a-98fae1e6fc3a req-409d4569-a6de-42df-b438-df871574d52b service nova] Creating event network-changed:414a4851-4f1f-4eac-9236-89ed850b9b5a for instance b5ebfa48-d140-464a-8556-590a2666ce0c on hv-cinder-84327 May 25 16:26:15.046490 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-eab7de1a-a217-4a05-a92a-98fae1e6fc3a req-409d4569-a6de-42df-b438-df871574d52b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054044 May 25 16:26:15.048356 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 349/704] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:26:15.072925 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-9b24402a-ae01-4d26-8dcc-c2369345bda9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:15.083311 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-9b24402a-ae01-4d26-8dcc-c2369345bda9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:15.084831 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-9b24402a-ae01-4d26-8dcc-c2369345bda9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:15.086016 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-9b24402a-ae01-4d26-8dcc-c2369345bda9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1724 microversion: 2.20 time: 0.217478 May 25 16:26:15.087132 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 356/705] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:14 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:15.766962 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-64732d83-d9ba-47e9-8f54-1e50789b2230 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:15.767676 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-64732d83-d9ba-47e9-8f54-1e50789b2230 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:15.774630 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-64732d83-d9ba-47e9-8f54-1e50789b2230 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:15.775119 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-64732d83-d9ba-47e9-8f54-1e50789b2230 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:15.775986 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-64732d83-d9ba-47e9-8f54-1e50789b2230 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:15.776986 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-64732d83-d9ba-47e9-8f54-1e50789b2230 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:15.933850 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-64732d83-d9ba-47e9-8f54-1e50789b2230 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:15.942426 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-64732d83-d9ba-47e9-8f54-1e50789b2230 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5" status: 200 len: 1367 microversion: 2.1 time: 0.179901 May 25 16:26:15.952227 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 350/706] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:15 2022] GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:26:16.104949 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-be2bef50-6600-41e9-954c-9e069b9d74c5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:16.105667 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-be2bef50-6600-41e9-954c-9e069b9d74c5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:16.112239 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-be2bef50-6600-41e9-954c-9e069b9d74c5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:16.112701 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-be2bef50-6600-41e9-954c-9e069b9d74c5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:16.113537 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-be2bef50-6600-41e9-954c-9e069b9d74c5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:16.114234 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-be2bef50-6600-41e9-954c-9e069b9d74c5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:16.281814 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-47d4dd5d-1e69-4868-a70f-bb7b8d1087f4 req-45da6e3b-e6a1-4338-bde8-058a8d9071f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "964d7f7e-8562-42f6-80c3-cd7d03c3f1c5", "name": "network-vif-plugged", "status": "completed", "tag": "dd94e749-35a1-4f34-8ff6-eddc3aa70245"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:26:16.297566 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-47d4dd5d-1e69-4868-a70f-bb7b8d1087f4 req-45da6e3b-e6a1-4338-bde8-058a8d9071f1 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:16.298089 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-47d4dd5d-1e69-4868-a70f-bb7b8d1087f4 req-45da6e3b-e6a1-4338-bde8-058a8d9071f1 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:16.304701 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-be2bef50-6600-41e9-954c-9e069b9d74c5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:16.314498 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-47d4dd5d-1e69-4868-a70f-bb7b8d1087f4 req-45da6e3b-e6a1-4338-bde8-058a8d9071f1 service nova] Creating event network-vif-plugged:dd94e749-35a1-4f34-8ff6-eddc3aa70245 for instance 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 on hv-cinder-84327 May 25 16:26:16.318271 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-be2bef50-6600-41e9-954c-9e069b9d74c5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:16.320586 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-47d4dd5d-1e69-4868-a70f-bb7b8d1087f4 req-45da6e3b-e6a1-4338-bde8-058a8d9071f1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048603 May 25 16:26:16.321372 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-be2bef50-6600-41e9-954c-9e069b9d74c5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:16.321702 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 351/707] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:26:16.323814 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-be2bef50-6600-41e9-954c-9e069b9d74c5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1724 microversion: 2.20 time: 0.222501 May 25 16:26:16.325249 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 357/708] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:16 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:16.965686 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-f80b3b81-c5d3-46df-9d79-69552fb3a231 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:16.967758 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-f80b3b81-c5d3-46df-9d79-69552fb3a231 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:16.977842 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f80b3b81-c5d3-46df-9d79-69552fb3a231 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:16.978578 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f80b3b81-c5d3-46df-9d79-69552fb3a231 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:16.980741 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f80b3b81-c5d3-46df-9d79-69552fb3a231 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:16.981476 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f80b3b81-c5d3-46df-9d79-69552fb3a231 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:17.129919 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-f80b3b81-c5d3-46df-9d79-69552fb3a231 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:17.137558 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-f80b3b81-c5d3-46df-9d79-69552fb3a231 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5" status: 200 len: 1367 microversion: 2.1 time: 0.180574 May 25 16:26:17.138162 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 352/709] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:16 2022] GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:26:17.343474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-4b386e08-40a6-47b7-906e-e2df87d6a721 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:17.344078 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-4b386e08-40a6-47b7-906e-e2df87d6a721 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:17.350233 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4b386e08-40a6-47b7-906e-e2df87d6a721 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:17.350681 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4b386e08-40a6-47b7-906e-e2df87d6a721 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:17.351444 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4b386e08-40a6-47b7-906e-e2df87d6a721 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:17.351883 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4b386e08-40a6-47b7-906e-e2df87d6a721 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:17.492277 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-4b386e08-40a6-47b7-906e-e2df87d6a721 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:17.500648 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-4b386e08-40a6-47b7-906e-e2df87d6a721 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:17.502181 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-4b386e08-40a6-47b7-906e-e2df87d6a721 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:17.503360 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-4b386e08-40a6-47b7-906e-e2df87d6a721 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1724 microversion: 2.20 time: 0.164419 May 25 16:26:17.503947 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 358/710] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:17 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:18.154916 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-c33a324f-29dc-40a0-918d-14109c7b7b8c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:18.155529 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-c33a324f-29dc-40a0-918d-14109c7b7b8c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:18.162253 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c33a324f-29dc-40a0-918d-14109c7b7b8c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:18.162705 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c33a324f-29dc-40a0-918d-14109c7b7b8c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:18.163460 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c33a324f-29dc-40a0-918d-14109c7b7b8c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:18.163894 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c33a324f-29dc-40a0-918d-14109c7b7b8c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:18.300520 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-c33a324f-29dc-40a0-918d-14109c7b7b8c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:18.309741 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-c33a324f-29dc-40a0-918d-14109c7b7b8c tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5" status: 200 len: 1367 microversion: 2.1 time: 0.158818 May 25 16:26:18.310457 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 353/711] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:18 2022] GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:26:18.523418 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-0f16d8a1-6cf0-4021-bc99-da7adf60dc8b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:18.524172 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-0f16d8a1-6cf0-4021-bc99-da7adf60dc8b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:18.531566 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0f16d8a1-6cf0-4021-bc99-da7adf60dc8b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:18.532291 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0f16d8a1-6cf0-4021-bc99-da7adf60dc8b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:18.533119 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0f16d8a1-6cf0-4021-bc99-da7adf60dc8b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:18.533557 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0f16d8a1-6cf0-4021-bc99-da7adf60dc8b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:18.678998 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-0f16d8a1-6cf0-4021-bc99-da7adf60dc8b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:18.687827 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-0f16d8a1-6cf0-4021-bc99-da7adf60dc8b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:18.689663 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-0f16d8a1-6cf0-4021-bc99-da7adf60dc8b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:18.691281 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-0f16d8a1-6cf0-4021-bc99-da7adf60dc8b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1724 microversion: 2.20 time: 0.172601 May 25 16:26:18.691840 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 359/712] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:18 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:19.329286 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-dc5235dc-2cca-44c0-a912-f7a414578314 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:19.330469 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-dc5235dc-2cca-44c0-a912-f7a414578314 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:19.338999 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dc5235dc-2cca-44c0-a912-f7a414578314 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:19.339598 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dc5235dc-2cca-44c0-a912-f7a414578314 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:19.340361 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dc5235dc-2cca-44c0-a912-f7a414578314 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:19.340796 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dc5235dc-2cca-44c0-a912-f7a414578314 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:19.493976 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-dc5235dc-2cca-44c0-a912-f7a414578314 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:19.502437 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-dc5235dc-2cca-44c0-a912-f7a414578314 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5" status: 200 len: 1557 microversion: 2.1 time: 0.176928 May 25 16:26:19.513759 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 354/713] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:26:19 2022] GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 => generated 1557 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:26:19.519542 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-d0680516-d921-4e9a-84b4-5bbeb26aa299 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:19.520125 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-d0680516-d921-4e9a-84b4-5bbeb26aa299 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:19.526257 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d0680516-d921-4e9a-84b4-5bbeb26aa299 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:19.527462 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d0680516-d921-4e9a-84b4-5bbeb26aa299 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:19.528267 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d0680516-d921-4e9a-84b4-5bbeb26aa299 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:19.528705 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d0680516-d921-4e9a-84b4-5bbeb26aa299 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:19.608253 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-d0680516-d921-4e9a-84b4-5bbeb26aa299 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092683 May 25 16:26:19.609163 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 360/714] 10.222.0.42 () {58 vars in 1274 bytes} [Wed May 25 16:26:19 2022] GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:26:19.709272 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-4e8597ec-7b24-49ef-a93b-7efc9e400cd7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:19.709918 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-4e8597ec-7b24-49ef-a93b-7efc9e400cd7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:19.716297 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4e8597ec-7b24-49ef-a93b-7efc9e400cd7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:19.717005 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4e8597ec-7b24-49ef-a93b-7efc9e400cd7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:19.717856 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4e8597ec-7b24-49ef-a93b-7efc9e400cd7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:19.718319 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4e8597ec-7b24-49ef-a93b-7efc9e400cd7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:19.922760 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-4e8597ec-7b24-49ef-a93b-7efc9e400cd7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:19.930620 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-4e8597ec-7b24-49ef-a93b-7efc9e400cd7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:19.932158 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-4e8597ec-7b24-49ef-a93b-7efc9e400cd7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:19.933911 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-4e8597ec-7b24-49ef-a93b-7efc9e400cd7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1724 microversion: 2.20 time: 0.228440 May 25 16:26:19.934478 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 355/715] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:19 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:20.956278 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-f198ea29-8bf7-4f3e-9846-9fa5b5737266 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:20.956921 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-f198ea29-8bf7-4f3e-9846-9fa5b5737266 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:20.963499 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f198ea29-8bf7-4f3e-9846-9fa5b5737266 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:20.964523 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-91068fce-bbe7-496d-9b42-66d915ec565a req-6f2a6964-0516-4216-beeb-9eac8eda7146 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "964d7f7e-8562-42f6-80c3-cd7d03c3f1c5", "tag": "dd94e749-35a1-4f34-8ff6-eddc3aa70245"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:26:20.964977 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f198ea29-8bf7-4f3e-9846-9fa5b5737266 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:20.965273 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f198ea29-8bf7-4f3e-9846-9fa5b5737266 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:20.965762 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f198ea29-8bf7-4f3e-9846-9fa5b5737266 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:20.971070 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_api:SELECT=100 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:26:20.976980 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-91068fce-bbe7-496d-9b42-66d915ec565a req-6f2a6964-0516-4216-beeb-9eac8eda7146 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:20.977752 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-91068fce-bbe7-496d-9b42-66d915ec565a req-6f2a6964-0516-4216-beeb-9eac8eda7146 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:20.990663 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-91068fce-bbe7-496d-9b42-66d915ec565a req-6f2a6964-0516-4216-beeb-9eac8eda7146 service nova] Creating event network-changed:dd94e749-35a1-4f34-8ff6-eddc3aa70245 for instance 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 on hv-cinder-84327 May 25 16:26:20.996427 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-91068fce-bbe7-496d-9b42-66d915ec565a req-6f2a6964-0516-4216-beeb-9eac8eda7146 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036662 May 25 16:26:20.997461 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 356/716] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:26:21.124955 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-f198ea29-8bf7-4f3e-9846-9fa5b5737266 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:21.133747 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-f198ea29-8bf7-4f3e-9846-9fa5b5737266 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:21.139482 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-f198ea29-8bf7-4f3e-9846-9fa5b5737266 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:21.140689 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-f198ea29-8bf7-4f3e-9846-9fa5b5737266 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1724 microversion: 2.20 time: 0.189013 May 25 16:26:21.141246 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 361/717] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:20 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:22.162066 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-b935eff8-cfc0-48f6-99ea-761b3325803b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:22.162769 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-b935eff8-cfc0-48f6-99ea-761b3325803b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:22.181137 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b935eff8-cfc0-48f6-99ea-761b3325803b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:22.181633 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b935eff8-cfc0-48f6-99ea-761b3325803b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:22.182601 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b935eff8-cfc0-48f6-99ea-761b3325803b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:22.183074 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b935eff8-cfc0-48f6-99ea-761b3325803b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:22.336700 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-b935eff8-cfc0-48f6-99ea-761b3325803b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:22.345914 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-b935eff8-cfc0-48f6-99ea-761b3325803b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:22.347589 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-b935eff8-cfc0-48f6-99ea-761b3325803b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:22.349231 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-b935eff8-cfc0-48f6-99ea-761b3325803b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1724 microversion: 2.20 time: 0.191604 May 25 16:26:22.349907 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 357/718] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:22 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:23.368122 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-2e5418fa-27b3-4f69-9bfb-b11f7a2705b9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:23.368664 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-2e5418fa-27b3-4f69-9bfb-b11f7a2705b9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:23.375696 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2e5418fa-27b3-4f69-9bfb-b11f7a2705b9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:23.376143 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2e5418fa-27b3-4f69-9bfb-b11f7a2705b9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:23.376897 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2e5418fa-27b3-4f69-9bfb-b11f7a2705b9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:23.377325 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2e5418fa-27b3-4f69-9bfb-b11f7a2705b9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:23.516460 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-2e5418fa-27b3-4f69-9bfb-b11f7a2705b9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:23.524474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-2e5418fa-27b3-4f69-9bfb-b11f7a2705b9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:23.526899 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-2e5418fa-27b3-4f69-9bfb-b11f7a2705b9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:23.528191 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-2e5418fa-27b3-4f69-9bfb-b11f7a2705b9 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1745 microversion: 2.20 time: 0.164053 May 25 16:26:23.532139 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 362/719] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:23 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:26:24.547615 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-c93fdb4e-26be-4a12-85ce-485014a591ef tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:24.548365 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-c93fdb4e-26be-4a12-85ce-485014a591ef tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:24.554922 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c93fdb4e-26be-4a12-85ce-485014a591ef tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:24.555372 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c93fdb4e-26be-4a12-85ce-485014a591ef tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:24.556130 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c93fdb4e-26be-4a12-85ce-485014a591ef tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:24.556560 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c93fdb4e-26be-4a12-85ce-485014a591ef tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:24.693107 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-c93fdb4e-26be-4a12-85ce-485014a591ef tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:24.701707 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-c93fdb4e-26be-4a12-85ce-485014a591ef tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:24.703327 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-c93fdb4e-26be-4a12-85ce-485014a591ef tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:24.704687 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-c93fdb4e-26be-4a12-85ce-485014a591ef tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1745 microversion: 2.20 time: 0.160910 May 25 16:26:24.705412 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 358/720] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:24 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:25.724677 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-dd5ee3eb-a4e4-443b-b022-ee3b9494b179 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:25.726033 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-dd5ee3eb-a4e4-443b-b022-ee3b9494b179 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:25.734251 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dd5ee3eb-a4e4-443b-b022-ee3b9494b179 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:25.735047 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dd5ee3eb-a4e4-443b-b022-ee3b9494b179 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:25.736877 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dd5ee3eb-a4e4-443b-b022-ee3b9494b179 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:25.737536 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dd5ee3eb-a4e4-443b-b022-ee3b9494b179 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:25.945068 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-dd5ee3eb-a4e4-443b-b022-ee3b9494b179 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:25.955219 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-dd5ee3eb-a4e4-443b-b022-ee3b9494b179 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:25.957779 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-dd5ee3eb-a4e4-443b-b022-ee3b9494b179 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:25.959369 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-dd5ee3eb-a4e4-443b-b022-ee3b9494b179 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1740 microversion: 2.20 time: 0.238860 May 25 16:26:25.960262 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 363/721] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:25 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1740 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:26.301969 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-c69a4b0b-3f4c-4d65-ab87-a759e3d38175 req-6ba24a8b-2cbc-4757-9b30-ddec6819cc1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7652df85-9116-41c0-b1a1-32a070414bd8", "name": "network-vif-plugged", "status": "completed", "tag": "3be8d920-dc13-499f-b9d6-d875dbb50bdc"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:26:26.317494 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-c69a4b0b-3f4c-4d65-ab87-a759e3d38175 req-6ba24a8b-2cbc-4757-9b30-ddec6819cc1c service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:26.318269 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-c69a4b0b-3f4c-4d65-ab87-a759e3d38175 req-6ba24a8b-2cbc-4757-9b30-ddec6819cc1c service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:26.334366 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-c69a4b0b-3f4c-4d65-ab87-a759e3d38175 req-6ba24a8b-2cbc-4757-9b30-ddec6819cc1c service nova] Creating event network-vif-plugged:3be8d920-dc13-499f-b9d6-d875dbb50bdc for instance 7652df85-9116-41c0-b1a1-32a070414bd8 on hv-cinder-84327 May 25 16:26:26.341331 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-c69a4b0b-3f4c-4d65-ab87-a759e3d38175 req-6ba24a8b-2cbc-4757-9b30-ddec6819cc1c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043212 May 25 16:26:26.342249 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 359/722] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:26:26.978476 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-be628628-c241-42f1-8f15-eda65246e0e0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:26.980009 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-be628628-c241-42f1-8f15-eda65246e0e0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:26.986135 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-be628628-c241-42f1-8f15-eda65246e0e0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:26.986839 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-be628628-c241-42f1-8f15-eda65246e0e0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:26.987840 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-be628628-c241-42f1-8f15-eda65246e0e0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:26.988470 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-be628628-c241-42f1-8f15-eda65246e0e0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:27.160846 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-be628628-c241-42f1-8f15-eda65246e0e0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:27.172485 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-be628628-c241-42f1-8f15-eda65246e0e0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:27.175385 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-be628628-c241-42f1-8f15-eda65246e0e0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:27.179179 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-be628628-c241-42f1-8f15-eda65246e0e0 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1740 microversion: 2.20 time: 0.204737 May 25 16:26:27.179972 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 364/723] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:26 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:28.199430 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-61f92d19-4b6a-40c2-9c16-863ea7902d47 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:28.200227 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-61f92d19-4b6a-40c2-9c16-863ea7902d47 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:28.211519 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-61f92d19-4b6a-40c2-9c16-863ea7902d47 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:28.211969 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-61f92d19-4b6a-40c2-9c16-863ea7902d47 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:28.212744 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-61f92d19-4b6a-40c2-9c16-863ea7902d47 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:28.213225 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-61f92d19-4b6a-40c2-9c16-863ea7902d47 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:28.381682 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-61f92d19-4b6a-40c2-9c16-863ea7902d47 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:28.395785 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-61f92d19-4b6a-40c2-9c16-863ea7902d47 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:28.399154 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-61f92d19-4b6a-40c2-9c16-863ea7902d47 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:28.401424 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-61f92d19-4b6a-40c2-9c16-863ea7902d47 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1740 microversion: 2.20 time: 0.206231 May 25 16:26:28.402731 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 360/724] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:28 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:29.433033 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-a5107200-9cc1-45e1-a80f-49c0615ad2d8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:29.433678 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-a5107200-9cc1-45e1-a80f-49c0615ad2d8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:29.444942 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a5107200-9cc1-45e1-a80f-49c0615ad2d8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:29.445623 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a5107200-9cc1-45e1-a80f-49c0615ad2d8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:29.446652 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a5107200-9cc1-45e1-a80f-49c0615ad2d8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:29.450034 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a5107200-9cc1-45e1-a80f-49c0615ad2d8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:29.690673 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-a5107200-9cc1-45e1-a80f-49c0615ad2d8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:29.702085 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-a5107200-9cc1-45e1-a80f-49c0615ad2d8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:29.710956 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-a5107200-9cc1-45e1-a80f-49c0615ad2d8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:29.712455 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-a5107200-9cc1-45e1-a80f-49c0615ad2d8 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1740 microversion: 2.20 time: 0.292782 May 25 16:26:29.724279 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 365/725] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:29 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1740 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:30.732279 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-4ff648a5-46df-4ebf-9370-8bbd96d5ffbe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:30.732866 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-4ff648a5-46df-4ebf-9370-8bbd96d5ffbe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:30.741044 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4ff648a5-46df-4ebf-9370-8bbd96d5ffbe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:30.741493 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4ff648a5-46df-4ebf-9370-8bbd96d5ffbe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:30.742298 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4ff648a5-46df-4ebf-9370-8bbd96d5ffbe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:30.742733 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4ff648a5-46df-4ebf-9370-8bbd96d5ffbe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:30.897192 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-4ff648a5-46df-4ebf-9370-8bbd96d5ffbe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:30.907554 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-4ff648a5-46df-4ebf-9370-8bbd96d5ffbe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:30.909446 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-4ff648a5-46df-4ebf-9370-8bbd96d5ffbe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:30.910705 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-4ff648a5-46df-4ebf-9370-8bbd96d5ffbe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1740 microversion: 2.20 time: 0.182939 May 25 16:26:30.911338 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 361/726] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:30 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:31.929007 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-99516b2e-21f6-4386-897d-6ba507d7c68c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:31.929685 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-99516b2e-21f6-4386-897d-6ba507d7c68c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:31.937505 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-99516b2e-21f6-4386-897d-6ba507d7c68c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:31.938060 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-99516b2e-21f6-4386-897d-6ba507d7c68c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:31.938907 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-99516b2e-21f6-4386-897d-6ba507d7c68c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:31.939339 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-99516b2e-21f6-4386-897d-6ba507d7c68c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:32.091765 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-99516b2e-21f6-4386-897d-6ba507d7c68c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:32.105113 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-99516b2e-21f6-4386-897d-6ba507d7c68c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:32.106980 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-99516b2e-21f6-4386-897d-6ba507d7c68c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:32.108151 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-99516b2e-21f6-4386-897d-6ba507d7c68c tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1740 microversion: 2.20 time: 0.183275 May 25 16:26:32.108713 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 366/727] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:31 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:33.128627 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-44d0157c-69ce-4203-97ac-479eb96eb728 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:33.129342 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-44d0157c-69ce-4203-97ac-479eb96eb728 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:33.137085 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-44d0157c-69ce-4203-97ac-479eb96eb728 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:33.137537 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-44d0157c-69ce-4203-97ac-479eb96eb728 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:33.138346 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-44d0157c-69ce-4203-97ac-479eb96eb728 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:33.138961 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-44d0157c-69ce-4203-97ac-479eb96eb728 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:33.280944 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-44d0157c-69ce-4203-97ac-479eb96eb728 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:33.289793 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-44d0157c-69ce-4203-97ac-479eb96eb728 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:33.292381 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-44d0157c-69ce-4203-97ac-479eb96eb728 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:33.293552 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-44d0157c-69ce-4203-97ac-479eb96eb728 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1740 microversion: 2.20 time: 0.171012 May 25 16:26:33.294506 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 362/728] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:33 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:34.313766 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-185a4731-a62a-4996-976f-24f047d52f20 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:34.314365 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-185a4731-a62a-4996-976f-24f047d52f20 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:34.320754 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-185a4731-a62a-4996-976f-24f047d52f20 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:34.321201 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-185a4731-a62a-4996-976f-24f047d52f20 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:34.321992 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-185a4731-a62a-4996-976f-24f047d52f20 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:34.323022 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-185a4731-a62a-4996-976f-24f047d52f20 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:34.476763 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-185a4731-a62a-4996-976f-24f047d52f20 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:34.487226 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-185a4731-a62a-4996-976f-24f047d52f20 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:34.488762 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-185a4731-a62a-4996-976f-24f047d52f20 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:34.489970 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-185a4731-a62a-4996-976f-24f047d52f20 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1740 microversion: 2.20 time: 0.180048 May 25 16:26:34.490536 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 367/729] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:34 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:35.508297 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-dc7dd202-d34c-494b-8749-1c60c8a9f48e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:35.508889 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-dc7dd202-d34c-494b-8749-1c60c8a9f48e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:35.515697 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dc7dd202-d34c-494b-8749-1c60c8a9f48e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:35.516138 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dc7dd202-d34c-494b-8749-1c60c8a9f48e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:35.516893 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dc7dd202-d34c-494b-8749-1c60c8a9f48e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:35.517321 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dc7dd202-d34c-494b-8749-1c60c8a9f48e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:35.648573 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-dc7dd202-d34c-494b-8749-1c60c8a9f48e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:35.657269 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-dc7dd202-d34c-494b-8749-1c60c8a9f48e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:35.658784 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-dc7dd202-d34c-494b-8749-1c60c8a9f48e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:35.659929 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-dc7dd202-d34c-494b-8749-1c60c8a9f48e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1722 microversion: 2.20 time: 0.155482 May 25 16:26:35.660477 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 363/730] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:35 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:36.682433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-5775a1f6-2fc6-4854-a76d-ce1f447270de tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:36.683134 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-5775a1f6-2fc6-4854-a76d-ce1f447270de tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:36.685018 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_api:SELECT=53 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:26:36.690344 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5775a1f6-2fc6-4854-a76d-ce1f447270de tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:36.690726 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5775a1f6-2fc6-4854-a76d-ce1f447270de tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:36.691487 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5775a1f6-2fc6-4854-a76d-ce1f447270de tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:36.691922 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5775a1f6-2fc6-4854-a76d-ce1f447270de tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:36.825908 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-5775a1f6-2fc6-4854-a76d-ce1f447270de tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:36.833871 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-5775a1f6-2fc6-4854-a76d-ce1f447270de tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:36.835250 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-5775a1f6-2fc6-4854-a76d-ce1f447270de tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:36.836384 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-5775a1f6-2fc6-4854-a76d-ce1f447270de tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1722 microversion: 2.20 time: 0.160096 May 25 16:26:36.836937 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 368/731] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:36 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:37.854945 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-84c388b0-c193-4e4b-9e13-edbf357447bc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:37.855550 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-84c388b0-c193-4e4b-9e13-edbf357447bc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:37.861584 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-84c388b0-c193-4e4b-9e13-edbf357447bc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:37.862062 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-84c388b0-c193-4e4b-9e13-edbf357447bc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:37.862825 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-84c388b0-c193-4e4b-9e13-edbf357447bc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:37.863260 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-84c388b0-c193-4e4b-9e13-edbf357447bc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:37.989172 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-84c388b0-c193-4e4b-9e13-edbf357447bc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:37.997866 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-84c388b0-c193-4e4b-9e13-edbf357447bc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:37.999362 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-84c388b0-c193-4e4b-9e13-edbf357447bc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:38.000496 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-84c388b0-c193-4e4b-9e13-edbf357447bc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1725 microversion: 2.20 time: 0.150142 May 25 16:26:38.001043 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 364/732] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:37 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:38.017846 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-dc3bbd8a-ac98-448e-a1a3-6094aa2deb5d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63b598ac-fc8f-43dd-9880-f889c4d42297"}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:26:38.018977 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-dc3bbd8a-ac98-448e-a1a3-6094aa2deb5d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:38.024897 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dc3bbd8a-ac98-448e-a1a3-6094aa2deb5d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:38.025880 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dc3bbd8a-ac98-448e-a1a3-6094aa2deb5d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:38.026782 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dc3bbd8a-ac98-448e-a1a3-6094aa2deb5d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:38.027218 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dc3bbd8a-ac98-448e-a1a3-6094aa2deb5d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:38.287063 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-8b7f5afd-fbf5-4ec7-b101-51815a668075 req-0491fc51-e041-4903-8509-76ad75b4b2aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7652df85-9116-41c0-b1a1-32a070414bd8", "name": "network-vif-unplugged", "status": "completed", "tag": "3be8d920-dc13-499f-b9d6-d875dbb50bdc"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:26:38.297499 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-8b7f5afd-fbf5-4ec7-b101-51815a668075 req-0491fc51-e041-4903-8509-76ad75b4b2aa service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:38.298055 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-8b7f5afd-fbf5-4ec7-b101-51815a668075 req-0491fc51-e041-4903-8509-76ad75b4b2aa service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:38.307275 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=100 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:26:38.310016 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:26:38.320417 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.compute.server_external_events [req-8b7f5afd-fbf5-4ec7-b101-51815a668075 req-0491fc51-e041-4903-8509-76ad75b4b2aa service nova] Unable to find a host for instance 7652df85-9116-41c0-b1a1-32a070414bd8. Dropping event network-vif-unplugged {{(pid=117510) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 25 16:26:38.321298 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-8b7f5afd-fbf5-4ec7-b101-51815a668075 req-0491fc51-e041-4903-8509-76ad75b4b2aa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.040608 May 25 16:26:38.324555 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 365/733] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 45 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 25 16:26:38.328030 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-dc3bbd8a-ac98-448e-a1a3-6094aa2deb5d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "POST /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.314114 May 25 16:26:38.329054 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 369/734] 10.222.0.42 () {62 vars in 1363 bytes} [Wed May 25 16:26:38 2022] POST /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8/os-volume_attachments => generated 188 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:26:38.453448 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-f7bde0ff-c856-475e-8903-a73193748548 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:38.454049 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-f7bde0ff-c856-475e-8903-a73193748548 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:38.460127 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f7bde0ff-c856-475e-8903-a73193748548 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:38.460573 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f7bde0ff-c856-475e-8903-a73193748548 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:38.461334 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f7bde0ff-c856-475e-8903-a73193748548 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:38.461798 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f7bde0ff-c856-475e-8903-a73193748548 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:38.710288 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-f7bde0ff-c856-475e-8903-a73193748548 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8/os-volume_attachments/63b598ac-fc8f-43dd-9880-f889c4d42297" status: 202 len: 0 microversion: 2.20 time: 0.262808 May 25 16:26:38.710816 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 366/735] 10.222.0.42 () {60 vars in 1456 bytes} [Wed May 25 16:26:38 2022] DELETE /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8/os-volume_attachments/63b598ac-fc8f-43dd-9880-f889c4d42297 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 16:26:38.769518 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-9bcb9987-edb1-4884-a3c5-b53e33369f72 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:26:38.770103 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-9bcb9987-edb1-4884-a3c5-b53e33369f72 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:38.777867 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9bcb9987-edb1-4884-a3c5-b53e33369f72 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:38.778312 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9bcb9987-edb1-4884-a3c5-b53e33369f72 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:38.779066 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9bcb9987-edb1-4884-a3c5-b53e33369f72 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:38.779496 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9bcb9987-edb1-4884-a3c5-b53e33369f72 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:38.868787 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-9bcb9987-edb1-4884-a3c5-b53e33369f72 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "POST /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8/action" status: 202 len: 0 microversion: 2.20 time: 0.102987 May 25 16:26:38.870053 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 370/736] 10.222.0.42 () {62 vars in 1318 bytes} [Wed May 25 16:26:38 2022] POST /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 16:26:38.878174 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-a3f428d4-6f77-4a77-b9f0-975e3956751e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:38.878953 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-a3f428d4-6f77-4a77-b9f0-975e3956751e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:38.886488 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a3f428d4-6f77-4a77-b9f0-975e3956751e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:38.887145 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a3f428d4-6f77-4a77-b9f0-975e3956751e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:38.887905 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a3f428d4-6f77-4a77-b9f0-975e3956751e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:38.888335 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a3f428d4-6f77-4a77-b9f0-975e3956751e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:39.021175 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-a3f428d4-6f77-4a77-b9f0-975e3956751e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:39.029136 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-a3f428d4-6f77-4a77-b9f0-975e3956751e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:39.030750 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-a3f428d4-6f77-4a77-b9f0-975e3956751e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:39.031971 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-a3f428d4-6f77-4a77-b9f0-975e3956751e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1673 microversion: 2.20 time: 0.157875 May 25 16:26:39.032526 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 367/737] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:38 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:40.050922 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-6d77e24c-d63f-4fda-ba41-e96efa8db7a7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:40.051597 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-6d77e24c-d63f-4fda-ba41-e96efa8db7a7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:40.058321 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6d77e24c-d63f-4fda-ba41-e96efa8db7a7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:40.059011 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6d77e24c-d63f-4fda-ba41-e96efa8db7a7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:40.059788 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6d77e24c-d63f-4fda-ba41-e96efa8db7a7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:40.060223 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6d77e24c-d63f-4fda-ba41-e96efa8db7a7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:40.195225 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-6d77e24c-d63f-4fda-ba41-e96efa8db7a7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:40.204040 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-6d77e24c-d63f-4fda-ba41-e96efa8db7a7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:40.205551 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-6d77e24c-d63f-4fda-ba41-e96efa8db7a7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:40.206719 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-6d77e24c-d63f-4fda-ba41-e96efa8db7a7 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1731 microversion: 2.20 time: 0.159801 May 25 16:26:40.207613 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 371/738] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:40 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:41.225970 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-5bd7bbd7-c1b8-4fee-9be9-54bd5d7f6602 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:41.226591 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-5bd7bbd7-c1b8-4fee-9be9-54bd5d7f6602 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:41.233164 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5bd7bbd7-c1b8-4fee-9be9-54bd5d7f6602 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:41.233617 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5bd7bbd7-c1b8-4fee-9be9-54bd5d7f6602 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:41.234432 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5bd7bbd7-c1b8-4fee-9be9-54bd5d7f6602 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:41.234870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5bd7bbd7-c1b8-4fee-9be9-54bd5d7f6602 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:41.373635 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-5bd7bbd7-c1b8-4fee-9be9-54bd5d7f6602 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:41.383467 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-5bd7bbd7-c1b8-4fee-9be9-54bd5d7f6602 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:41.386644 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-5bd7bbd7-c1b8-4fee-9be9-54bd5d7f6602 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:41.387842 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-5bd7bbd7-c1b8-4fee-9be9-54bd5d7f6602 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1731 microversion: 2.20 time: 0.166026 May 25 16:26:41.388397 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 368/739] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:41 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:42.406081 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-8f240f46-5538-449c-959e-ca41f77f013d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:42.406704 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-8f240f46-5538-449c-959e-ca41f77f013d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:42.412904 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8f240f46-5538-449c-959e-ca41f77f013d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:42.413586 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8f240f46-5538-449c-959e-ca41f77f013d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:42.414385 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8f240f46-5538-449c-959e-ca41f77f013d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:42.414821 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8f240f46-5538-449c-959e-ca41f77f013d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:42.556509 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-8f240f46-5538-449c-959e-ca41f77f013d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:42.565097 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-8f240f46-5538-449c-959e-ca41f77f013d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:42.566639 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-8f240f46-5538-449c-959e-ca41f77f013d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:42.567801 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-8f240f46-5538-449c-959e-ca41f77f013d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1731 microversion: 2.20 time: 0.165754 May 25 16:26:42.568547 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 372/740] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:42 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:43.586281 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-4dbb2006-3795-4922-bd2a-ad44f1b74fb5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:43.586834 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-4dbb2006-3795-4922-bd2a-ad44f1b74fb5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:43.594219 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4dbb2006-3795-4922-bd2a-ad44f1b74fb5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:43.594758 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4dbb2006-3795-4922-bd2a-ad44f1b74fb5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:43.595521 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4dbb2006-3795-4922-bd2a-ad44f1b74fb5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:43.595964 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4dbb2006-3795-4922-bd2a-ad44f1b74fb5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:43.730290 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-4dbb2006-3795-4922-bd2a-ad44f1b74fb5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:43.738577 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-4dbb2006-3795-4922-bd2a-ad44f1b74fb5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:43.740075 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-4dbb2006-3795-4922-bd2a-ad44f1b74fb5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:43.741868 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-4dbb2006-3795-4922-bd2a-ad44f1b74fb5 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1731 microversion: 2.20 time: 0.159133 May 25 16:26:43.741868 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 369/741] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:43 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:44.760846 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-35679317-436b-4c2b-aeb0-6eb59d12707f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:44.761399 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-35679317-436b-4c2b-aeb0-6eb59d12707f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:44.767304 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-35679317-436b-4c2b-aeb0-6eb59d12707f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:44.767749 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-35679317-436b-4c2b-aeb0-6eb59d12707f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:44.769429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-35679317-436b-4c2b-aeb0-6eb59d12707f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:44.770146 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-35679317-436b-4c2b-aeb0-6eb59d12707f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:44.903756 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-35679317-436b-4c2b-aeb0-6eb59d12707f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:44.912232 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-35679317-436b-4c2b-aeb0-6eb59d12707f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:44.913757 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-35679317-436b-4c2b-aeb0-6eb59d12707f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:44.914911 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-35679317-436b-4c2b-aeb0-6eb59d12707f tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1731 microversion: 2.20 time: 0.158701 May 25 16:26:44.915468 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 373/742] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:44 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:45.933596 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-96735f4f-b284-495f-89bb-93bd6f4bc536 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:45.934248 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-96735f4f-b284-495f-89bb-93bd6f4bc536 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:45.941108 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-96735f4f-b284-495f-89bb-93bd6f4bc536 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:45.941557 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-96735f4f-b284-495f-89bb-93bd6f4bc536 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:45.942379 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-96735f4f-b284-495f-89bb-93bd6f4bc536 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:45.942815 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-96735f4f-b284-495f-89bb-93bd6f4bc536 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:46.082013 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-96735f4f-b284-495f-89bb-93bd6f4bc536 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:46.090633 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-96735f4f-b284-495f-89bb-93bd6f4bc536 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:46.092234 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-96735f4f-b284-495f-89bb-93bd6f4bc536 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:46.093451 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-96735f4f-b284-495f-89bb-93bd6f4bc536 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1731 microversion: 2.20 time: 0.164315 May 25 16:26:46.094052 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 370/743] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:45 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:47.113043 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-de8c02e7-86b3-46ec-93a2-bc5397391887 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:47.113663 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-de8c02e7-86b3-46ec-93a2-bc5397391887 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:47.120905 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-de8c02e7-86b3-46ec-93a2-bc5397391887 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:47.121312 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-de8c02e7-86b3-46ec-93a2-bc5397391887 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:47.122128 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-de8c02e7-86b3-46ec-93a2-bc5397391887 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:47.122549 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-de8c02e7-86b3-46ec-93a2-bc5397391887 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:47.256185 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-de8c02e7-86b3-46ec-93a2-bc5397391887 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:47.266984 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-de8c02e7-86b3-46ec-93a2-bc5397391887 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:47.268486 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-de8c02e7-86b3-46ec-93a2-bc5397391887 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:47.269641 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-de8c02e7-86b3-46ec-93a2-bc5397391887 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1731 microversion: 2.20 time: 0.161067 May 25 16:26:47.270225 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 374/744] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:47 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:48.288310 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-75816c99-4621-4a31-a192-d5b174d3ffb2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:48.288994 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-75816c99-4621-4a31-a192-d5b174d3ffb2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:48.294549 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-d8b123f9-4a8a-4984-baa5-5c7895f701f7 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:48.295112 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-d8b123f9-4a8a-4984-baa5-5c7895f701f7 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:48.295908 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-75816c99-4621-4a31-a192-d5b174d3ffb2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:48.296356 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-75816c99-4621-4a31-a192-d5b174d3ffb2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:48.297124 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-75816c99-4621-4a31-a192-d5b174d3ffb2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:48.297553 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-75816c99-4621-4a31-a192-d5b174d3ffb2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:48.302707 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d8b123f9-4a8a-4984-baa5-5c7895f701f7 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:48.302707 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d8b123f9-4a8a-4984-baa5-5c7895f701f7 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:48.303134 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d8b123f9-4a8a-4984-baa5-5c7895f701f7 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:48.303621 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d8b123f9-4a8a-4984-baa5-5c7895f701f7 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:48.329525 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-d8b123f9-4a8a-4984-baa5-5c7895f701f7 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44/ips" status: 200 len: 147 microversion: 2.1 time: 0.039565 May 25 16:26:48.330361 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 375/745] 10.222.0.42 () {58 vars in 1247 bytes} [Wed May 25 16:26:48 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:26:48.468631 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-75816c99-4621-4a31-a192-d5b174d3ffb2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:48.477588 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-75816c99-4621-4a31-a192-d5b174d3ffb2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:48.479189 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-75816c99-4621-4a31-a192-d5b174d3ffb2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:48.480374 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-75816c99-4621-4a31-a192-d5b174d3ffb2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1731 microversion: 2.20 time: 0.196224 May 25 16:26:48.481053 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 371/746] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:48 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:49.499484 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-95f62952-8e5f-4d97-9585-b6923fae0633 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:49.500149 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-95f62952-8e5f-4d97-9585-b6923fae0633 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:49.506163 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-95f62952-8e5f-4d97-9585-b6923fae0633 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:49.506614 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-95f62952-8e5f-4d97-9585-b6923fae0633 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:49.507370 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-95f62952-8e5f-4d97-9585-b6923fae0633 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:49.507809 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-95f62952-8e5f-4d97-9585-b6923fae0633 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:49.643968 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-95f62952-8e5f-4d97-9585-b6923fae0633 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:49.653622 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-95f62952-8e5f-4d97-9585-b6923fae0633 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:49.655541 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-95f62952-8e5f-4d97-9585-b6923fae0633 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:49.656946 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-95f62952-8e5f-4d97-9585-b6923fae0633 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1731 microversion: 2.20 time: 0.161335 May 25 16:26:49.658246 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 376/747] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:49 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:49.716671 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-52a1fb15-9ff4-4f60-b322-ae3b9df6f2f6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "821e7635-a416-4257-bb1d-15132954fa20"}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:26:49.717745 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-52a1fb15-9ff4-4f60-b322-ae3b9df6f2f6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:49.724653 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-52a1fb15-9ff4-4f60-b322-ae3b9df6f2f6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:49.725097 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-52a1fb15-9ff4-4f60-b322-ae3b9df6f2f6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:49.726142 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-52a1fb15-9ff4-4f60-b322-ae3b9df6f2f6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:49.726765 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-52a1fb15-9ff4-4f60-b322-ae3b9df6f2f6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:50.677462 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-0984ac71-0de1-4bda-8460-de9824486024 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:50.678088 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-0984ac71-0de1-4bda-8460-de9824486024 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:50.684129 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0984ac71-0de1-4bda-8460-de9824486024 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:50.684571 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0984ac71-0de1-4bda-8460-de9824486024 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:50.685381 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0984ac71-0de1-4bda-8460-de9824486024 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:50.685841 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0984ac71-0de1-4bda-8460-de9824486024 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:50.818600 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-0984ac71-0de1-4bda-8460-de9824486024 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:50.827049 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-0984ac71-0de1-4bda-8460-de9824486024 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:50.828532 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-0984ac71-0de1-4bda-8460-de9824486024 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:50.829663 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-0984ac71-0de1-4bda-8460-de9824486024 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1731 microversion: 2.20 time: 0.156086 May 25 16:26:50.830241 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 377/748] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:50 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:26:51.022395 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-52a1fb15-9ff4-4f60-b322-ae3b9df6f2f6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "POST /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.310060 May 25 16:26:51.023160 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 372/749] 10.222.0.42 () {60 vars in 1322 bytes} [Wed May 25 16:26:49 2022] POST /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44/os-volume_attachments => generated 194 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:26:51.847437 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-83eeaf93-c8e0-4f46-9a14-e295ec19f179 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:51.848051 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-83eeaf93-c8e0-4f46-9a14-e295ec19f179 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:51.854046 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-83eeaf93-c8e0-4f46-9a14-e295ec19f179 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:51.854490 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-83eeaf93-c8e0-4f46-9a14-e295ec19f179 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:51.855238 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-83eeaf93-c8e0-4f46-9a14-e295ec19f179 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:51.855675 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-83eeaf93-c8e0-4f46-9a14-e295ec19f179 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:51.981338 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-83eeaf93-c8e0-4f46-9a14-e295ec19f179 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:51.989157 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-83eeaf93-c8e0-4f46-9a14-e295ec19f179 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:51.990757 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-83eeaf93-c8e0-4f46-9a14-e295ec19f179 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:51.991893 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-83eeaf93-c8e0-4f46-9a14-e295ec19f179 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1731 microversion: 2.20 time: 0.148403 May 25 16:26:51.992452 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 378/750] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:51 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:53.012358 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-3cbc8d0f-b27c-46d7-93fc-e517b44dfd9d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:53.013079 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-3cbc8d0f-b27c-46d7-93fc-e517b44dfd9d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:53.014996 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_api:SELECT=33 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:26:53.020934 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3cbc8d0f-b27c-46d7-93fc-e517b44dfd9d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:53.021389 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3cbc8d0f-b27c-46d7-93fc-e517b44dfd9d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:53.022196 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3cbc8d0f-b27c-46d7-93fc-e517b44dfd9d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:53.022637 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3cbc8d0f-b27c-46d7-93fc-e517b44dfd9d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:53.151754 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-3cbc8d0f-b27c-46d7-93fc-e517b44dfd9d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:53.160380 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-3cbc8d0f-b27c-46d7-93fc-e517b44dfd9d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:53.162186 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-3cbc8d0f-b27c-46d7-93fc-e517b44dfd9d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:53.163330 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-3cbc8d0f-b27c-46d7-93fc-e517b44dfd9d tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1731 microversion: 2.20 time: 0.156403 May 25 16:26:53.163891 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 373/751] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:53 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:54.182659 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-d6f8d15b-0a04-408c-9c2e-0109f4713546 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:54.183251 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-d6f8d15b-0a04-408c-9c2e-0109f4713546 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:54.189375 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d6f8d15b-0a04-408c-9c2e-0109f4713546 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:54.189877 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d6f8d15b-0a04-408c-9c2e-0109f4713546 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:54.190634 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d6f8d15b-0a04-408c-9c2e-0109f4713546 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:54.191065 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d6f8d15b-0a04-408c-9c2e-0109f4713546 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:54.328327 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-d6f8d15b-0a04-408c-9c2e-0109f4713546 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:54.336231 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-d6f8d15b-0a04-408c-9c2e-0109f4713546 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:54.338546 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-d6f8d15b-0a04-408c-9c2e-0109f4713546 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:54.339703 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-d6f8d15b-0a04-408c-9c2e-0109f4713546 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1731 microversion: 2.20 time: 0.160982 May 25 16:26:54.340263 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 379/752] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:54 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:55.358375 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-60b6f389-e96e-4956-9410-220a18c5e65e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:55.358950 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-60b6f389-e96e-4956-9410-220a18c5e65e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:55.365511 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-60b6f389-e96e-4956-9410-220a18c5e65e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:55.365996 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-60b6f389-e96e-4956-9410-220a18c5e65e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:55.366763 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-60b6f389-e96e-4956-9410-220a18c5e65e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:55.367198 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-60b6f389-e96e-4956-9410-220a18c5e65e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:55.500244 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-60b6f389-e96e-4956-9410-220a18c5e65e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:55.508049 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-60b6f389-e96e-4956-9410-220a18c5e65e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:55.509636 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-60b6f389-e96e-4956-9410-220a18c5e65e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:55.511115 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-60b6f389-e96e-4956-9410-220a18c5e65e tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1731 microversion: 2.20 time: 0.156697 May 25 16:26:55.511672 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 374/753] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:55 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:56.492487 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-7eb034ff-f925-4a29-9c8a-94be9a5646a3 req-09cc8150-3ba7-4af9-90c2-26baf6369451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7652df85-9116-41c0-b1a1-32a070414bd8", "name": "network-vif-plugged", "status": "completed", "tag": "3be8d920-dc13-499f-b9d6-d875dbb50bdc"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:26:56.502787 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-7eb034ff-f925-4a29-9c8a-94be9a5646a3 req-09cc8150-3ba7-4af9-90c2-26baf6369451 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:56.503446 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-7eb034ff-f925-4a29-9c8a-94be9a5646a3 req-09cc8150-3ba7-4af9-90c2-26baf6369451 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:56.515624 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-7eb034ff-f925-4a29-9c8a-94be9a5646a3 req-09cc8150-3ba7-4af9-90c2-26baf6369451 service nova] Creating event network-vif-plugged:3be8d920-dc13-499f-b9d6-d875dbb50bdc for instance 7652df85-9116-41c0-b1a1-32a070414bd8 on hv-cinder-84327 May 25 16:26:56.520598 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-7eb034ff-f925-4a29-9c8a-94be9a5646a3 req-09cc8150-3ba7-4af9-90c2-26baf6369451 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032080 May 25 16:26:56.521259 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 380/754] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:26:56.528367 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-b27ea748-1b39-47a8-968a-7af5d84c3293 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:56.528971 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-b27ea748-1b39-47a8-968a-7af5d84c3293 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:56.536167 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b27ea748-1b39-47a8-968a-7af5d84c3293 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:56.537081 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b27ea748-1b39-47a8-968a-7af5d84c3293 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:56.538130 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b27ea748-1b39-47a8-968a-7af5d84c3293 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:56.538582 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b27ea748-1b39-47a8-968a-7af5d84c3293 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:56.684617 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-b27ea748-1b39-47a8-968a-7af5d84c3293 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:56.692776 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-b27ea748-1b39-47a8-968a-7af5d84c3293 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:56.694326 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-b27ea748-1b39-47a8-968a-7af5d84c3293 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:56.695866 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-b27ea748-1b39-47a8-968a-7af5d84c3293 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1731 microversion: 2.20 time: 0.171095 May 25 16:26:56.696614 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 375/755] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:56 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:57.715449 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-02e873b8-c346-4a34-84c9-bd869142f56b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:57.716061 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-02e873b8-c346-4a34-84c9-bd869142f56b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:57.722327 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-02e873b8-c346-4a34-84c9-bd869142f56b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:57.722773 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-02e873b8-c346-4a34-84c9-bd869142f56b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:57.723531 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-02e873b8-c346-4a34-84c9-bd869142f56b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:57.723964 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-02e873b8-c346-4a34-84c9-bd869142f56b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:57.850227 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-02e873b8-c346-4a34-84c9-bd869142f56b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:57.858255 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-02e873b8-c346-4a34-84c9-bd869142f56b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:57.859753 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-02e873b8-c346-4a34-84c9-bd869142f56b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:57.860890 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-02e873b8-c346-4a34-84c9-bd869142f56b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1731 microversion: 2.20 time: 0.149822 May 25 16:26:57.861450 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 381/756] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:57 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:26:58.880280 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-8c3a2890-7797-4182-a63c-37547c23be83 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:58.880892 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-8c3a2890-7797-4182-a63c-37547c23be83 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:58.888254 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8c3a2890-7797-4182-a63c-37547c23be83 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:58.888696 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8c3a2890-7797-4182-a63c-37547c23be83 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:58.889461 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8c3a2890-7797-4182-a63c-37547c23be83 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:58.889960 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8c3a2890-7797-4182-a63c-37547c23be83 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:59.031297 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-8c3a2890-7797-4182-a63c-37547c23be83 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:59.039534 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-8c3a2890-7797-4182-a63c-37547c23be83 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:59.041536 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-8c3a2890-7797-4182-a63c-37547c23be83 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:26:59.042785 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-8c3a2890-7797-4182-a63c-37547c23be83 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1731 microversion: 2.20 time: 0.166382 May 25 16:26:59.050915 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 376/757] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:26:58 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:26:59.590174 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-24ab9715-b8c2-4e1b-ab63-63656d821f5d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:59.591109 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-24ab9715-b8c2-4e1b-ab63-63656d821f5d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:59.597001 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-24ab9715-b8c2-4e1b-ab63-63656d821f5d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:59.597443 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-24ab9715-b8c2-4e1b-ab63-63656d821f5d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:59.598233 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-24ab9715-b8c2-4e1b-ab63-63656d821f5d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:59.598667 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-24ab9715-b8c2-4e1b-ab63-63656d821f5d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:59.627936 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-24ab9715-b8c2-4e1b-ab63-63656d821f5d tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042152 May 25 16:26:59.628483 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 382/758] 10.222.0.42 () {58 vars in 1301 bytes} [Wed May 25 16:26:59 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:26:59.638565 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-42769a34-416e-4482-80cb-05d261b4fee6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:26:59.639056 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-42769a34-416e-4482-80cb-05d261b4fee6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:26:59.644881 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-42769a34-416e-4482-80cb-05d261b4fee6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:59.645324 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-42769a34-416e-4482-80cb-05d261b4fee6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:59.646122 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-42769a34-416e-4482-80cb-05d261b4fee6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:26:59.646549 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-42769a34-416e-4482-80cb-05d261b4fee6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:26:59.674738 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-42769a34-416e-4482-80cb-05d261b4fee6 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44/os-volume_attachments/821e7635-a416-4257-bb1d-15132954fa20" status: 200 len: 194 microversion: 2.1 time: 0.040409 May 25 16:26:59.675297 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 377/759] 10.222.0.42 () {58 vars in 1412 bytes} [Wed May 25 16:26:59 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44/os-volume_attachments/821e7635-a416-4257-bb1d-15132954fa20 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:27:00.061093 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-9ccb7f38-64f3-4aa2-bd4a-48d0f26e2a15 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:00.061697 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-9ccb7f38-64f3-4aa2-bd4a-48d0f26e2a15 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:00.068537 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9ccb7f38-64f3-4aa2-bd4a-48d0f26e2a15 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:00.068982 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9ccb7f38-64f3-4aa2-bd4a-48d0f26e2a15 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:00.069758 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9ccb7f38-64f3-4aa2-bd4a-48d0f26e2a15 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:00.070193 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9ccb7f38-64f3-4aa2-bd4a-48d0f26e2a15 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:00.204706 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-9ccb7f38-64f3-4aa2-bd4a-48d0f26e2a15 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:27:00.213249 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-9ccb7f38-64f3-4aa2-bd4a-48d0f26e2a15 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:27:00.214773 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-9ccb7f38-64f3-4aa2-bd4a-48d0f26e2a15 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:27:00.216062 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-9ccb7f38-64f3-4aa2-bd4a-48d0f26e2a15 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1718 microversion: 2.20 time: 0.159031 May 25 16:27:00.216519 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 383/760] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:27:00 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:27:00.986694 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-2c2ef9c0-ffb4-446b-9db8-7d90d8314fda tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60f16cd7-8769-46d7-8bfc-ea7f74c81730"}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:27:00.987795 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-2c2ef9c0-ffb4-446b-9db8-7d90d8314fda tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:00.996857 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2c2ef9c0-ffb4-446b-9db8-7d90d8314fda tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:00.997306 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2c2ef9c0-ffb4-446b-9db8-7d90d8314fda tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:00.998111 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2c2ef9c0-ffb4-446b-9db8-7d90d8314fda tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:00.998545 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2c2ef9c0-ffb4-446b-9db8-7d90d8314fda tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:01.067923 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:27:01.234958 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-2c2ef9c0-ffb4-446b-9db8-7d90d8314fda tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "POST /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252064 May 25 16:27:01.235612 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 378/761] 10.222.0.42 () {60 vars in 1322 bytes} [Wed May 25 16:27:00 2022] POST /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:27:07.768065 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-bacdff39-90a0-4887-a015-0c6307b6eb9d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:07.768664 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-bacdff39-90a0-4887-a015-0c6307b6eb9d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:07.770667 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_api:SELECT=34 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:27:07.776689 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-bacdff39-90a0-4887-a015-0c6307b6eb9d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:07.777138 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-bacdff39-90a0-4887-a015-0c6307b6eb9d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:07.777929 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-bacdff39-90a0-4887-a015-0c6307b6eb9d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:07.778363 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-bacdff39-90a0-4887-a015-0c6307b6eb9d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:07.802221 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-bacdff39-90a0-4887-a015-0c6307b6eb9d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5/ips" status: 200 len: 150 microversion: 2.1 time: 0.038115 May 25 16:27:07.802795 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 384/762] 10.222.0.42 () {58 vars in 1247 bytes} [Wed May 25 16:27:07 2022] GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:27:08.731438 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-1aceb7ab-bf42-45eb-a479-a41b5ed7f8dc tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:08.732493 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-1aceb7ab-bf42-45eb-a479-a41b5ed7f8dc tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:08.738935 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1aceb7ab-bf42-45eb-a479-a41b5ed7f8dc tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:08.739395 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1aceb7ab-bf42-45eb-a479-a41b5ed7f8dc tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:08.740139 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1aceb7ab-bf42-45eb-a479-a41b5ed7f8dc tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:08.740578 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1aceb7ab-bf42-45eb-a479-a41b5ed7f8dc tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:08.769682 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-1aceb7ab-bf42-45eb-a479-a41b5ed7f8dc tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043724 May 25 16:27:08.770250 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 379/763] 10.222.0.42 () {58 vars in 1301 bytes} [Wed May 25 16:27:08 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:27:08.916211 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-39330fe3-dd66-4aa4-8c20-babc4dfb9f98 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:08.916813 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-39330fe3-dd66-4aa4-8c20-babc4dfb9f98 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:08.922683 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-39330fe3-dd66-4aa4-8c20-babc4dfb9f98 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:08.923123 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-39330fe3-dd66-4aa4-8c20-babc4dfb9f98 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:08.923876 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-39330fe3-dd66-4aa4-8c20-babc4dfb9f98 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:08.924302 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-39330fe3-dd66-4aa4-8c20-babc4dfb9f98 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:08.926632 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=87,nova_cell1:INSERT=1 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:27:08.953573 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-39330fe3-dd66-4aa4-8c20-babc4dfb9f98 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44/os-volume_attachments/821e7635-a416-4257-bb1d-15132954fa20" status: 200 len: 194 microversion: 2.1 time: 0.042311 May 25 16:27:08.954112 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 385/764] 10.222.0.42 () {58 vars in 1412 bytes} [Wed May 25 16:27:08 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44/os-volume_attachments/821e7635-a416-4257-bb1d-15132954fa20 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:27:08.964196 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-026690f7-f3cc-4b61-8925-af6fdaa14ff0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:08.964695 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-026690f7-f3cc-4b61-8925-af6fdaa14ff0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:08.971213 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-026690f7-f3cc-4b61-8925-af6fdaa14ff0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:08.971666 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-026690f7-f3cc-4b61-8925-af6fdaa14ff0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:08.972427 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-026690f7-f3cc-4b61-8925-af6fdaa14ff0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:08.972865 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-026690f7-f3cc-4b61-8925-af6fdaa14ff0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:09.053581 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.objects.instance [None req-026690f7-f3cc-4b61-8925-af6fdaa14ff0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lazy-loading 'services' on Instance uuid 50c1e1a5-ce7f-4032-b028-431051dfde44 {{(pid=117510) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:27:09.124580 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-da80a573-bea1-4309-a973-4ed4c57f14b9 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c999f72-51a7-4fd7-bff5-7cfa1289b95b"}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:27:09.125619 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-da80a573-bea1-4309-a973-4ed4c57f14b9 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:09.131673 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-026690f7-f3cc-4b61-8925-af6fdaa14ff0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "DELETE /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44/os-volume_attachments/821e7635-a416-4257-bb1d-15132954fa20" status: 202 len: 0 microversion: 2.1 time: 0.171762 May 25 16:27:09.131850 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-da80a573-bea1-4309-a973-4ed4c57f14b9 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:09.132106 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-da80a573-bea1-4309-a973-4ed4c57f14b9 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:09.132242 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 380/765] 10.222.0.42 () {58 vars in 1415 bytes} [Wed May 25 16:27:08 2022] DELETE /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44/os-volume_attachments/821e7635-a416-4257-bb1d-15132954fa20 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:27:09.132877 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-da80a573-bea1-4309-a973-4ed4c57f14b9 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:09.133296 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-da80a573-bea1-4309-a973-4ed4c57f14b9 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:09.715257 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-da80a573-bea1-4309-a973-4ed4c57f14b9 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "POST /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.594467 May 25 16:27:09.715783 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 386/766] 10.222.0.42 () {60 vars in 1322 bytes} [Wed May 25 16:27:09 2022] POST /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5/os-volume_attachments => generated 194 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:27:11.318164 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-b115e45b-2d4e-4b78-8360-93644c6a7b38 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:11.318743 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-b115e45b-2d4e-4b78-8360-93644c6a7b38 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:11.326190 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b115e45b-2d4e-4b78-8360-93644c6a7b38 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:11.326541 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b115e45b-2d4e-4b78-8360-93644c6a7b38 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:11.327304 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b115e45b-2d4e-4b78-8360-93644c6a7b38 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:11.327741 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b115e45b-2d4e-4b78-8360-93644c6a7b38 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:11.356815 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-b115e45b-2d4e-4b78-8360-93644c6a7b38 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44/os-volume_attachments/60f16cd7-8769-46d7-8bfc-ea7f74c81730" status: 200 len: 194 microversion: 2.1 time: 0.043018 May 25 16:27:11.357381 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 381/767] 10.222.0.42 () {58 vars in 1412 bytes} [Wed May 25 16:27:11 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44/os-volume_attachments/60f16cd7-8769-46d7-8bfc-ea7f74c81730 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:27:11.368635 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-6148d957-8d92-445a-baca-2885725e85aa tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:11.369270 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-6148d957-8d92-445a-baca-2885725e85aa tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:11.375417 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6148d957-8d92-445a-baca-2885725e85aa tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:11.375858 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6148d957-8d92-445a-baca-2885725e85aa tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:11.376611 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6148d957-8d92-445a-baca-2885725e85aa tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:11.377043 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6148d957-8d92-445a-baca-2885725e85aa tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:11.461281 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.objects.instance [None req-6148d957-8d92-445a-baca-2885725e85aa tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lazy-loading 'services' on Instance uuid 50c1e1a5-ce7f-4032-b028-431051dfde44 {{(pid=117509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:27:11.532741 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-6148d957-8d92-445a-baca-2885725e85aa tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "DELETE /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44/os-volume_attachments/60f16cd7-8769-46d7-8bfc-ea7f74c81730" status: 202 len: 0 microversion: 2.1 time: 0.169261 May 25 16:27:11.533429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 387/768] 10.222.0.42 () {58 vars in 1415 bytes} [Wed May 25 16:27:11 2022] DELETE /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44/os-volume_attachments/60f16cd7-8769-46d7-8bfc-ea7f74c81730 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:27:17.319230 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-547b5264-00cc-4d59-9c4d-c46035892183 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:17.319834 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-547b5264-00cc-4d59-9c4d-c46035892183 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:17.327478 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-547b5264-00cc-4d59-9c4d-c46035892183 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:17.327929 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-547b5264-00cc-4d59-9c4d-c46035892183 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:17.328698 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-547b5264-00cc-4d59-9c4d-c46035892183 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:17.329127 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-547b5264-00cc-4d59-9c4d-c46035892183 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:17.409315 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.objects.instance [None req-547b5264-00cc-4d59-9c4d-c46035892183 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lazy-loading 'services' on Instance uuid 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 {{(pid=117510) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:27:17.488572 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-547b5264-00cc-4d59-9c4d-c46035892183 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "DELETE /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5/os-volume_attachments/0c999f72-51a7-4fd7-bff5-7cfa1289b95b" status: 202 len: 0 microversion: 2.1 time: 0.173041 May 25 16:27:17.489182 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 382/769] 10.222.0.42 () {58 vars in 1415 bytes} [Wed May 25 16:27:17 2022] DELETE /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5/os-volume_attachments/0c999f72-51a7-4fd7-bff5-7cfa1289b95b => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:27:17.498666 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-2917b67e-8913-4ba4-a9fb-594fe5fad868 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:17.499813 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-2917b67e-8913-4ba4-a9fb-594fe5fad868 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:17.506444 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2917b67e-8913-4ba4-a9fb-594fe5fad868 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:17.507067 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2917b67e-8913-4ba4-a9fb-594fe5fad868 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:17.508054 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2917b67e-8913-4ba4-a9fb-594fe5fad868 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:17.509076 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2917b67e-8913-4ba4-a9fb-594fe5fad868 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:17.539751 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-2917b67e-8913-4ba4-a9fb-594fe5fad868 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045917 May 25 16:27:17.540454 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 388/770] 10.222.0.42 () {58 vars in 1301 bytes} [Wed May 25 16:27:17 2022] GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:27:17.968914 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-ebe7ee90-f5dd-4b1b-a552-4a863ee1ed26 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:17.970073 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-ebe7ee90-f5dd-4b1b-a552-4a863ee1ed26 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:17.976240 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ebe7ee90-f5dd-4b1b-a552-4a863ee1ed26 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:17.976692 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ebe7ee90-f5dd-4b1b-a552-4a863ee1ed26 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:17.977794 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ebe7ee90-f5dd-4b1b-a552-4a863ee1ed26 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:17.978232 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ebe7ee90-f5dd-4b1b-a552-4a863ee1ed26 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:18.006714 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-ebe7ee90-f5dd-4b1b-a552-4a863ee1ed26 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042191 May 25 16:27:18.007260 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 383/771] 10.222.0.42 () {58 vars in 1301 bytes} [Wed May 25 16:27:17 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 16:27:18.114644 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-399b6e85-6d15-4f5f-ad2e-c54c87c90c78 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:18.115571 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-399b6e85-6d15-4f5f-ad2e-c54c87c90c78 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:18.123338 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-399b6e85-6d15-4f5f-ad2e-c54c87c90c78 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:18.123722 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-399b6e85-6d15-4f5f-ad2e-c54c87c90c78 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:18.124494 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-399b6e85-6d15-4f5f-ad2e-c54c87c90c78 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:18.124930 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-399b6e85-6d15-4f5f-ad2e-c54c87c90c78 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:18.154216 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-399b6e85-6d15-4f5f-ad2e-c54c87c90c78 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043517 May 25 16:27:18.154785 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 389/772] 10.222.0.42 () {58 vars in 1301 bytes} [Wed May 25 16:27:18 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 16:27:18.214683 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-065692e9-8814-474d-a0bb-9ba889792d47 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:18.215228 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-065692e9-8814-474d-a0bb-9ba889792d47 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:18.221641 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-065692e9-8814-474d-a0bb-9ba889792d47 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:18.222148 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-065692e9-8814-474d-a0bb-9ba889792d47 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:18.223045 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-065692e9-8814-474d-a0bb-9ba889792d47 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:18.223489 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-065692e9-8814-474d-a0bb-9ba889792d47 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:18.252164 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-065692e9-8814-474d-a0bb-9ba889792d47 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Going to try to terminate instance {{(pid=117510) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:27:18.332065 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-065692e9-8814-474d-a0bb-9ba889792d47 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "DELETE /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44" status: 204 len: 0 microversion: 2.1 time: 0.121145 May 25 16:27:18.332978 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 384/773] 10.222.0.42 () {58 vars in 1238 bytes} [Wed May 25 16:27:18 2022] DELETE /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:27:18.341403 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-b554c33b-b04c-442e-bfbd-f1892b99a1b0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:18.342043 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-b554c33b-b04c-442e-bfbd-f1892b99a1b0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:18.347941 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b554c33b-b04c-442e-bfbd-f1892b99a1b0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:18.348390 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b554c33b-b04c-442e-bfbd-f1892b99a1b0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:18.349146 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b554c33b-b04c-442e-bfbd-f1892b99a1b0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:18.349578 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b554c33b-b04c-442e-bfbd-f1892b99a1b0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:18.476863 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-b554c33b-b04c-442e-bfbd-f1892b99a1b0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:27:18.484880 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-b554c33b-b04c-442e-bfbd-f1892b99a1b0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44" status: 200 len: 1674 microversion: 2.1 time: 0.147297 May 25 16:27:18.485446 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 390/774] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:27:18 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:27:18.552283 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-7d29db20-a57d-4e68-9808-08b18825292d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:18.553285 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-7d29db20-a57d-4e68-9808-08b18825292d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:18.559495 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7d29db20-a57d-4e68-9808-08b18825292d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:18.559947 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7d29db20-a57d-4e68-9808-08b18825292d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:18.560712 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7d29db20-a57d-4e68-9808-08b18825292d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:18.561146 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7d29db20-a57d-4e68-9808-08b18825292d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:18.591948 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-7d29db20-a57d-4e68-9808-08b18825292d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043955 May 25 16:27:18.592607 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 385/775] 10.222.0.42 () {58 vars in 1301 bytes} [Wed May 25 16:27:18 2022] GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 16:27:18.650518 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-7ff31377-8cf3-481b-8bec-ece4ce3da9bb tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:18.651018 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-7ff31377-8cf3-481b-8bec-ece4ce3da9bb tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:18.656927 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7ff31377-8cf3-481b-8bec-ece4ce3da9bb tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:18.657369 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7ff31377-8cf3-481b-8bec-ece4ce3da9bb tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:18.658154 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7ff31377-8cf3-481b-8bec-ece4ce3da9bb tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:18.658583 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7ff31377-8cf3-481b-8bec-ece4ce3da9bb tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:18.684064 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-7ff31377-8cf3-481b-8bec-ece4ce3da9bb tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Going to try to terminate instance {{(pid=117509) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:27:18.756411 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-7ff31377-8cf3-481b-8bec-ece4ce3da9bb tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "DELETE /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5" status: 204 len: 0 microversion: 2.1 time: 0.109932 May 25 16:27:18.757027 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 391/776] 10.222.0.42 () {58 vars in 1238 bytes} [Wed May 25 16:27:18 2022] DELETE /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 25 16:27:18.764993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-57643355-dc4e-45fd-93e9-6dbf4390eeac tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:18.765602 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-57643355-dc4e-45fd-93e9-6dbf4390eeac tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:18.771619 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-57643355-dc4e-45fd-93e9-6dbf4390eeac tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:18.772065 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-57643355-dc4e-45fd-93e9-6dbf4390eeac tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:18.772826 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-57643355-dc4e-45fd-93e9-6dbf4390eeac tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:18.773258 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-57643355-dc4e-45fd-93e9-6dbf4390eeac tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:18.904166 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-57643355-dc4e-45fd-93e9-6dbf4390eeac tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:27:18.911819 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-57643355-dc4e-45fd-93e9-6dbf4390eeac tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5" status: 200 len: 1682 microversion: 2.1 time: 0.150337 May 25 16:27:18.912455 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 386/777] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:27:18 2022] GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:27:19.503995 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-fc86a9e9-72ac-4121-a134-a1dc96f398ac tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:19.504730 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-fc86a9e9-72ac-4121-a134-a1dc96f398ac tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:19.512494 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fc86a9e9-72ac-4121-a134-a1dc96f398ac tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:19.512942 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fc86a9e9-72ac-4121-a134-a1dc96f398ac tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:19.513797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fc86a9e9-72ac-4121-a134-a1dc96f398ac tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:19.514237 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fc86a9e9-72ac-4121-a134-a1dc96f398ac tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:19.642772 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-fc86a9e9-72ac-4121-a134-a1dc96f398ac tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:27:19.650550 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-fc86a9e9-72ac-4121-a134-a1dc96f398ac tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44" status: 200 len: 1674 microversion: 2.1 time: 0.150976 May 25 16:27:19.651147 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 392/778] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:27:19 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:27:19.929468 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-a82b5e8c-2c0f-42b1-9262-8ff648183c04 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:19.930103 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-a82b5e8c-2c0f-42b1-9262-8ff648183c04 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:19.937261 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a82b5e8c-2c0f-42b1-9262-8ff648183c04 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:19.937739 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a82b5e8c-2c0f-42b1-9262-8ff648183c04 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:19.938505 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a82b5e8c-2c0f-42b1-9262-8ff648183c04 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:19.938948 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a82b5e8c-2c0f-42b1-9262-8ff648183c04 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:20.069936 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-a82b5e8c-2c0f-42b1-9262-8ff648183c04 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:27:20.077429 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-a82b5e8c-2c0f-42b1-9262-8ff648183c04 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5" status: 200 len: 1682 microversion: 2.1 time: 0.151963 May 25 16:27:20.078020 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 387/779] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:27:19 2022] GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:27:20.668285 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-c9e5f14b-fd18-4926-a9dc-06e20da710b1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:20.668891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-c9e5f14b-fd18-4926-a9dc-06e20da710b1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:20.675615 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c9e5f14b-fd18-4926-a9dc-06e20da710b1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:20.676062 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c9e5f14b-fd18-4926-a9dc-06e20da710b1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:20.676821 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c9e5f14b-fd18-4926-a9dc-06e20da710b1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:20.677258 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c9e5f14b-fd18-4926-a9dc-06e20da710b1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:20.802462 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-c9e5f14b-fd18-4926-a9dc-06e20da710b1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:27:20.810554 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-c9e5f14b-fd18-4926-a9dc-06e20da710b1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44" status: 200 len: 1674 microversion: 2.1 time: 0.146354 May 25 16:27:20.811119 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 393/780] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:27:20 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44 => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:27:21.094216 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-3d4dfa18-0127-46d8-806c-02c8fe6d4162 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:21.094832 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-3d4dfa18-0127-46d8-806c-02c8fe6d4162 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:21.101159 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3d4dfa18-0127-46d8-806c-02c8fe6d4162 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:21.101634 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3d4dfa18-0127-46d8-806c-02c8fe6d4162 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:21.102420 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3d4dfa18-0127-46d8-806c-02c8fe6d4162 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:21.102854 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3d4dfa18-0127-46d8-806c-02c8fe6d4162 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:21.229015 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-3d4dfa18-0127-46d8-806c-02c8fe6d4162 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:27:21.237009 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-3d4dfa18-0127-46d8-806c-02c8fe6d4162 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5" status: 200 len: 1682 microversion: 2.1 time: 0.146624 May 25 16:27:21.237572 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 388/781] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:27:21 2022] GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:27:21.828570 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-f6fd6e61-2f8e-4112-bccc-fecb5c044f05 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:21.829327 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-f6fd6e61-2f8e-4112-bccc-fecb5c044f05 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:21.837020 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f6fd6e61-2f8e-4112-bccc-fecb5c044f05 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:21.837472 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f6fd6e61-2f8e-4112-bccc-fecb5c044f05 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:21.838271 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f6fd6e61-2f8e-4112-bccc-fecb5c044f05 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:21.838700 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f6fd6e61-2f8e-4112-bccc-fecb5c044f05 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:21.972336 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-f6fd6e61-2f8e-4112-bccc-fecb5c044f05 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:27:21.979962 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-f6fd6e61-2f8e-4112-bccc-fecb5c044f05 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44" status: 200 len: 1674 microversion: 2.1 time: 0.155349 May 25 16:27:21.980635 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 394/782] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:27:21 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:27:22.255626 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-34418e22-3031-4779-837f-3264005ee8aa tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:22.256257 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-34418e22-3031-4779-837f-3264005ee8aa tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:22.264230 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-34418e22-3031-4779-837f-3264005ee8aa tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:22.264992 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-34418e22-3031-4779-837f-3264005ee8aa tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:22.266088 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-34418e22-3031-4779-837f-3264005ee8aa tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:22.266568 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-34418e22-3031-4779-837f-3264005ee8aa tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:22.557201 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-34418e22-3031-4779-837f-3264005ee8aa tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:27:22.566029 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-34418e22-3031-4779-837f-3264005ee8aa tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5" status: 200 len: 1682 microversion: 2.1 time: 0.314392 May 25 16:27:22.566601 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 389/783] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:27:22 2022] GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 => generated 1682 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:27:22.996917 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-ede8b814-3d2c-40ef-acbc-3ddd26ac2388 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:22.997539 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-ede8b814-3d2c-40ef-acbc-3ddd26ac2388 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:23.004026 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ede8b814-3d2c-40ef-acbc-3ddd26ac2388 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:23.004467 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ede8b814-3d2c-40ef-acbc-3ddd26ac2388 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:23.005222 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ede8b814-3d2c-40ef-acbc-3ddd26ac2388 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:23.005650 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ede8b814-3d2c-40ef-acbc-3ddd26ac2388 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:23.071870 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-ede8b814-3d2c-40ef-acbc-3ddd26ac2388 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:27:23.080635 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-ede8b814-3d2c-40ef-acbc-3ddd26ac2388 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44" status: 200 len: 1607 microversion: 2.1 time: 0.087952 May 25 16:27:23.081226 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 395/784] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:27:22 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44 => generated 1607 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:27:23.584733 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-05d0dfe6-762f-4f08-933d-33fd9ba20f98 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:23.585420 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-05d0dfe6-762f-4f08-933d-33fd9ba20f98 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:23.589246 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:27:23.596975 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-05d0dfe6-762f-4f08-933d-33fd9ba20f98 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:23.597758 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-05d0dfe6-762f-4f08-933d-33fd9ba20f98 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:23.598833 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-05d0dfe6-762f-4f08-933d-33fd9ba20f98 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:23.599515 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-05d0dfe6-762f-4f08-933d-33fd9ba20f98 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:23.633083 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-8b2ec6b9-818e-42f8-b432-1d447549dec9 req-fc98c85d-619a-422f-82a6-cc7cb9b5ce69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50c1e1a5-ce7f-4032-b028-431051dfde44", "name": "network-vif-deleted", "tag": "a3612e40-f8ea-4391-b684-977f3fa2cfff"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:27:23.694231 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-8b2ec6b9-818e-42f8-b432-1d447549dec9 req-fc98c85d-619a-422f-82a6-cc7cb9b5ce69 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:23.695278 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-8b2ec6b9-818e-42f8-b432-1d447549dec9 req-fc98c85d-619a-422f-82a6-cc7cb9b5ce69 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:23.747248 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-8b2ec6b9-818e-42f8-b432-1d447549dec9 req-fc98c85d-619a-422f-82a6-cc7cb9b5ce69 service nova] Creating event network-vif-deleted:a3612e40-f8ea-4391-b684-977f3fa2cfff for instance 50c1e1a5-ce7f-4032-b028-431051dfde44 on hv-cinder-84327 May 25 16:27:23.763465 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-8b2ec6b9-818e-42f8-b432-1d447549dec9 req-fc98c85d-619a-422f-82a6-cc7cb9b5ce69 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134549 May 25 16:27:23.767088 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-05d0dfe6-762f-4f08-933d-33fd9ba20f98 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b781c4c6cb61439fb781988a7da028ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d234edace28441282f594f0e03cacc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:27:23.774815 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 396/785] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:27:23.776414 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-05d0dfe6-762f-4f08-933d-33fd9ba20f98 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5" status: 200 len: 1615 microversion: 2.1 time: 0.195994 May 25 16:27:23.781514 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 390/786] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:27:23 2022] GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 => generated 1615 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:27:24.099945 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-71d52984-d3af-42f9-b111-e79103476345 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:24.100820 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-71d52984-d3af-42f9-b111-e79103476345 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:24.108589 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-71d52984-d3af-42f9-b111-e79103476345 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:24.109230 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-71d52984-d3af-42f9-b111-e79103476345 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:24.110168 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-71d52984-d3af-42f9-b111-e79103476345 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:24.110743 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-71d52984-d3af-42f9-b111-e79103476345 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:24.150269 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-71d52984-d3af-42f9-b111-e79103476345 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:24.150734 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-71d52984-d3af-42f9-b111-e79103476345 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:24.151794 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.objects.instance [None req-71d52984-d3af-42f9-b111-e79103476345 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lazy-loading 'fault' on Instance uuid 50c1e1a5-ce7f-4032-b028-431051dfde44 {{(pid=117509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:27:24.202452 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-71d52984-d3af-42f9-b111-e79103476345 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fae427f22d476fa0e378949de41292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8c39550e4e41e79cc56aa7d22ae052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:27:24.211249 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-71d52984-d3af-42f9-b111-e79103476345 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44" status: 200 len: 1327 microversion: 2.1 time: 0.116164 May 25 16:27:24.211947 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 397/787] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:27:24 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44 => generated 1327 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:27:24.799042 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-dfb26875-f71e-45d6-9449-14bca70f1a4d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:24.799846 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-dfb26875-f71e-45d6-9449-14bca70f1a4d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:24.806301 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dfb26875-f71e-45d6-9449-14bca70f1a4d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:24.806686 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dfb26875-f71e-45d6-9449-14bca70f1a4d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:24.807496 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dfb26875-f71e-45d6-9449-14bca70f1a4d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:24.807939 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dfb26875-f71e-45d6-9449-14bca70f1a4d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:24.811869 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:27:24.822146 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.wsgi [None req-dfb26875-f71e-45d6-9449-14bca70f1a4d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] HTTP exception thrown: Instance 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 could not be found. May 25 16:27:24.824277 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-dfb26875-f71e-45d6-9449-14bca70f1a4d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Request method failure captured: May 25 16:27:24.824277 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: request: GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 HTTP/1.1 May 25 16:27:24.824277 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept: application/json May 25 16:27:24.824277 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept-Encoding: identity May 25 16:27:24.824277 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Connection: close May 25 16:27:24.824277 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Length: 0 May 25 16:27:24.824277 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Type: application/json May 25 16:27:24.824277 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Host: 10.222.0.42 May 25 16:27:24.824277 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Openstack-System-Scope: None May 25 16:27:24.824277 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: User-Agent: python-urllib3/1.26.9 May 25 16:27:24.824277 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Auth-Token: gAAAAABijldM9TsAZJy8dFB1DMOmN3fYD4FVUv3HZ7K9WxI11fcxXnHOFEKVQuqoz4pXUAyb9YMnHusiEz5_9NIfv66CxCRP6OYrV0TQFouqehYLNaYvAb5OzaoSF8oLgazxJMBBuxROCk5D-B6RTnZ7yadTSJVodvBMZSALenmgyavmYCv9RJ0 May 25 16:27:24.824277 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Id: None May 25 16:27:24.824277 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Name: None May 25 16:27:24.824277 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Identity-Status: Confirmed May 25 16:27:24.824277 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Is-Admin-Project: True May 25 16:27:24.824277 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Id: default May 25 16:27:24.824277 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Name: Default May 25 16:27:24.824277 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Id: 9d234edace28441282f594f0e03cacc5 May 25 16:27:24.824277 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Name: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:27:24.824277 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Role: reader,member May 25 16:27:24.824277 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Roles: reader,member May 25 16:27:24.826242 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d234edace28441282f594f0e03cacc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d234edace28441282f594f0e03cacc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d234edace28441282f594f0e03cacc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d234edace28441282f594f0e03cacc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:27:24.826242 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:27:24.826242 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Id: 9d234edace28441282f594f0e03cacc5 May 25 16:27:24.826242 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:27:24.826242 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User: tempest-AttachVolumeNegativeTest-1719621589-project May 25 16:27:24.826242 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Id: default May 25 16:27:24.826242 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Name: Default May 25 16:27:24.826242 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Id: b781c4c6cb61439fb781988a7da028ff May 25 16:27:24.826242 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Name: tempest-AttachVolumeNegativeTest-1719621589-project May 25 16:27:24.826242 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: method: > May 25 16:27:24.826242 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: exception: Instance 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 could not be found. May 25 16:27:24.826242 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: action_args: {'id': '964d7f7e-8562-42f6-80c3-cd7d03c3f1c5'} May 25 16:27:24.827055 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:27:24.827055 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:24.827055 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:27:24.827055 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:27:24.827055 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:27:24.827055 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:27:24.827055 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:27:24.827055 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:27:24.827055 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:27:24.827055 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:27:24.827055 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 could not be found. May 25 16:27:24.827055 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:24.827055 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:24.827055 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:24.827055 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:24.827055 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:24.827055 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:24.827055 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:27:24.827055 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:27:24.827055 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:27:24.828450 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:27:24.828450 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:27:24.828450 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:27:24.828450 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:27:24.828450 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:27:24.828450 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:27:24.828450 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:27:24.828450 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 could not be found. May 25 16:27:24.828450 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:24.828450 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:24.828450 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:24.828450 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:24.828450 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:24.828450 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:24.828450 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:27:24.828450 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:27:24.828450 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 could not be found. May 25 16:27:24.828450 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:24.829792 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-dfb26875-f71e-45d6-9449-14bca70f1a4d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Returning 404 to user: Instance 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 could not be found. {{(pid=117510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:27:24.829792 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-dfb26875-f71e-45d6-9449-14bca70f1a4d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5" status: 404 len: 111 microversion: 2.1 time: 0.030701 May 25 16:27:24.829792 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 391/788] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:27:24 2022] GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:27:24.835118 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-9586a886-581d-40f9-b648-8579ed20df1a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '.version_select at 0x7f51f335c1f0>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:24.853615 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-9586a886-581d-40f9-b648-8579ed20df1a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1727039587" status: 202 len: 0 microversion: 2.1 time: 0.022156 May 25 16:27:24.854722 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 398/789] 10.222.0.42 () {58 vars in 1220 bytes} [Wed May 25 16:27:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1727039587 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:27:25.231396 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-7bee44bb-b97b-48fc-a7ab-a343e884fd2e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:25.232097 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-7bee44bb-b97b-48fc-a7ab-a343e884fd2e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:25.239100 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7bee44bb-b97b-48fc-a7ab-a343e884fd2e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:25.239628 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7bee44bb-b97b-48fc-a7ab-a343e884fd2e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:25.240467 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7bee44bb-b97b-48fc-a7ab-a343e884fd2e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:25.240972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7bee44bb-b97b-48fc-a7ab-a343e884fd2e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:25.255044 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.wsgi [None req-7bee44bb-b97b-48fc-a7ab-a343e884fd2e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] HTTP exception thrown: Instance 50c1e1a5-ce7f-4032-b028-431051dfde44 could not be found. May 25 16:27:25.256584 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-7bee44bb-b97b-48fc-a7ab-a343e884fd2e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Request method failure captured: May 25 16:27:25.256584 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: request: GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44 HTTP/1.1 May 25 16:27:25.256584 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept: application/json May 25 16:27:25.256584 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept-Encoding: identity May 25 16:27:25.256584 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Connection: close May 25 16:27:25.256584 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Length: 0 May 25 16:27:25.256584 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Type: application/json May 25 16:27:25.256584 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Host: 10.222.0.42 May 25 16:27:25.256584 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Openstack-System-Scope: None May 25 16:27:25.256584 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: User-Agent: python-urllib3/1.26.9 May 25 16:27:25.256584 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Auth-Token: gAAAAABijldXnJWiX7WFaRzhSEZJEpgFMy11by1fa61p9fQ2_iYXx_dOqUEpT-Xfhu8XvnV5IAA4PJl4j2v3l07QABoVYuYSBM3EOpnApdVO5VSaVNlYF1RGhdi0o4Y57dwP6pzcSNOaGdIhQeVOY8MKMXsXB0pJHoem7prbNsejF47pgT8V-yg May 25 16:27:25.256584 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Id: None May 25 16:27:25.256584 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Name: None May 25 16:27:25.256584 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Identity-Status: Confirmed May 25 16:27:25.256584 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Is-Admin-Project: True May 25 16:27:25.256584 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Id: default May 25 16:27:25.256584 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Name: Default May 25 16:27:25.256584 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Id: 3e8c39550e4e41e79cc56aa7d22ae052 May 25 16:27:25.256584 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Name: tempest-AttachVolumeTestJSON-1756534258 May 25 16:27:25.256584 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Role: reader,member May 25 16:27:25.256584 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Roles: reader,member May 25 16:27:25.258131 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e8c39550e4e41e79cc56aa7d22ae052"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3e8c39550e4e41e79cc56aa7d22ae052"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3e8c39550e4e41e79cc56aa7d22ae052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e8c39550e4e41e79cc56aa7d22ae052"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:27:25.258131 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant: tempest-AttachVolumeTestJSON-1756534258 May 25 16:27:25.258131 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Id: 3e8c39550e4e41e79cc56aa7d22ae052 May 25 16:27:25.258131 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1756534258 May 25 16:27:25.258131 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User: tempest-AttachVolumeTestJSON-1756534258-project May 25 16:27:25.258131 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Id: default May 25 16:27:25.258131 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Name: Default May 25 16:27:25.258131 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Id: 15fae427f22d476fa0e378949de41292 May 25 16:27:25.258131 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Name: tempest-AttachVolumeTestJSON-1756534258-project May 25 16:27:25.258131 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: method: > May 25 16:27:25.258131 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: exception: Instance 50c1e1a5-ce7f-4032-b028-431051dfde44 could not be found. May 25 16:27:25.258131 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: action_args: {'id': '50c1e1a5-ce7f-4032-b028-431051dfde44'} May 25 16:27:25.259090 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:27:25.259090 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:25.259090 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:27:25.259090 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:27:25.259090 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:27:25.259090 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:27:25.259090 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:27:25.259090 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:27:25.259090 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:27:25.259090 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:27:25.259090 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50c1e1a5-ce7f-4032-b028-431051dfde44 could not be found. May 25 16:27:25.259090 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:25.259090 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:25.259090 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:25.259090 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:25.259090 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:25.259090 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:25.259090 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:27:25.259090 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:27:25.259090 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:27:25.261158 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:27:25.261158 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:27:25.261158 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:27:25.261158 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:27:25.261158 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:27:25.261158 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:27:25.261158 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:27:25.261158 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50c1e1a5-ce7f-4032-b028-431051dfde44 could not be found. May 25 16:27:25.261158 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:25.261158 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:25.261158 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:25.261158 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:25.261158 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:25.261158 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:25.261158 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:27:25.261158 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:27:25.261158 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50c1e1a5-ce7f-4032-b028-431051dfde44 could not be found. May 25 16:27:25.261158 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:25.262504 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-7bee44bb-b97b-48fc-a7ab-a343e884fd2e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Returning 404 to user: Instance 50c1e1a5-ce7f-4032-b028-431051dfde44 could not be found. {{(pid=117510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:27:25.262504 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-7bee44bb-b97b-48fc-a7ab-a343e884fd2e tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44" status: 404 len: 111 microversion: 2.1 time: 0.030831 May 25 16:27:25.262504 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 392/790] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:27:25 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:27:25.269284 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-1e40a3f8-eb9e-4beb-8876-60446e29f0b3 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '.version_select at 0x7f51f333af70>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:25.290399 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-1e40a3f8-eb9e-4beb-8876-60446e29f0b3 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-250809736" status: 202 len: 0 microversion: 2.1 time: 0.025789 May 25 16:27:25.290907 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 399/791] 10.222.0.42 () {58 vars in 1217 bytes} [Wed May 25 16:27:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-250809736 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:27:25.798459 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-8ed7af79-09d3-4686-b26a-af76e1badbbb req-f9b11f03-be74-4948-8a14-6cba83b6b9c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "964d7f7e-8562-42f6-80c3-cd7d03c3f1c5", "name": "network-vif-deleted", "tag": "dd94e749-35a1-4f34-8ff6-eddc3aa70245"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:27:25.808007 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-8ed7af79-09d3-4686-b26a-af76e1badbbb req-f9b11f03-be74-4948-8a14-6cba83b6b9c8 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:25.808567 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-8ed7af79-09d3-4686-b26a-af76e1badbbb req-f9b11f03-be74-4948-8a14-6cba83b6b9c8 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:25.821534 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-8ed7af79-09d3-4686-b26a-af76e1badbbb req-f9b11f03-be74-4948-8a14-6cba83b6b9c8 service nova] Creating event network-vif-deleted:dd94e749-35a1-4f34-8ff6-eddc3aa70245 for instance 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 on hv-cinder-84327 May 25 16:27:25.827006 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-8ed7af79-09d3-4686-b26a-af76e1badbbb req-f9b11f03-be74-4948-8a14-6cba83b6b9c8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032253 May 25 16:27:25.827697 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 393/792] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:27:26.905277 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-f1ee6d7b-b4b2-4da2-86b2-103121952ec4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:26.905868 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-f1ee6d7b-b4b2-4da2-86b2-103121952ec4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:26.913460 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f1ee6d7b-b4b2-4da2-86b2-103121952ec4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:26.914060 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f1ee6d7b-b4b2-4da2-86b2-103121952ec4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:26.914883 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f1ee6d7b-b4b2-4da2-86b2-103121952ec4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:26.915387 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f1ee6d7b-b4b2-4da2-86b2-103121952ec4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:26.929677 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.wsgi [None req-f1ee6d7b-b4b2-4da2-86b2-103121952ec4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] HTTP exception thrown: Instance 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 could not be found. May 25 16:27:26.931446 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-f1ee6d7b-b4b2-4da2-86b2-103121952ec4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Request method failure captured: May 25 16:27:26.931446 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: DELETE /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 HTTP/1.1 May 25 16:27:26.931446 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:27:26.931446 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:27:26.931446 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:27:26.931446 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 0 May 25 16:27:26.931446 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:27:26.931446 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:27:26.931446 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:27:26.931446 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:27:26.931446 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijldM9TsAZJy8dFB1DMOmN3fYD4FVUv3HZ7K9WxI11fcxXnHOFEKVQuqoz4pXUAyb9YMnHusiEz5_9NIfv66CxCRP6OYrV0TQFouqehYLNaYvAb5OzaoSF8oLgazxJMBBuxROCk5D-B6RTnZ7yadTSJVodvBMZSALenmgyavmYCv9RJ0 May 25 16:27:26.931446 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:27:26.931446 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:27:26.931446 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:27:26.931446 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:27:26.931446 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:27:26.931446 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:27:26.931446 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: 9d234edace28441282f594f0e03cacc5 May 25 16:27:26.931446 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:27:26.931446 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:27:26.931446 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:27:26.933675 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d234edace28441282f594f0e03cacc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d234edace28441282f594f0e03cacc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d234edace28441282f594f0e03cacc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d234edace28441282f594f0e03cacc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:27:26.933675 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:27:26.933675 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: 9d234edace28441282f594f0e03cacc5 May 25 16:27:26.933675 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:27:26.933675 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-AttachVolumeNegativeTest-1719621589-project May 25 16:27:26.933675 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:27:26.933675 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:27:26.933675 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: b781c4c6cb61439fb781988a7da028ff May 25 16:27:26.933675 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-AttachVolumeNegativeTest-1719621589-project May 25 16:27:26.933675 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: > May 25 16:27:26.933675 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Instance 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 could not be found. May 25 16:27:26.933675 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'id': '964d7f7e-8562-42f6-80c3-cd7d03c3f1c5'} May 25 16:27:26.934587 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:27:26.934587 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:26.934587 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:27:26.934587 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:27:26.934587 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:27:26.934587 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:27:26.934587 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:27:26.934587 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:27:26.934587 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:27:26.934587 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:27:26.934587 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 could not be found. May 25 16:27:26.934587 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:26.934587 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:26.934587 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:26.934587 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:26.934587 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:26.934587 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:26.934587 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:27:26.934587 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:27:26.934587 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:27:26.935891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:27:26.935891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 16:27:26.935891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 16:27:26.935891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 16:27:26.935891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 16:27:26.935891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:27:26.935891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:27:26.935891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:27:26.935891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:27:26.935891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 could not be found. May 25 16:27:26.935891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:26.935891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:26.935891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:26.935891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:26.935891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:26.935891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:26.935891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:27:26.935891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:27:26.935891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 could not be found. May 25 16:27:26.935891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:26.937167 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-f1ee6d7b-b4b2-4da2-86b2-103121952ec4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Returning 404 to user: Instance 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 could not be found. {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:27:26.937167 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-f1ee6d7b-b4b2-4da2-86b2-103121952ec4 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "DELETE /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5" status: 404 len: 111 microversion: 2.1 time: 0.032974 May 25 16:27:26.937167 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 400/793] 10.222.0.42 () {58 vars in 1238 bytes} [Wed May 25 16:27:26 2022] DELETE /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:27:26.944014 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-2dd20055-d440-4080-8283-37d8708ffc0d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:26.944764 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-2dd20055-d440-4080-8283-37d8708ffc0d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:26.952820 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2dd20055-d440-4080-8283-37d8708ffc0d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:26.953301 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2dd20055-d440-4080-8283-37d8708ffc0d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:26.954097 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2dd20055-d440-4080-8283-37d8708ffc0d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:26.954574 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2dd20055-d440-4080-8283-37d8708ffc0d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:26.968255 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.wsgi [None req-2dd20055-d440-4080-8283-37d8708ffc0d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] HTTP exception thrown: Instance 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 could not be found. May 25 16:27:26.969873 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-2dd20055-d440-4080-8283-37d8708ffc0d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Request method failure captured: May 25 16:27:26.969873 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: request: GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 HTTP/1.1 May 25 16:27:26.969873 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept: application/json May 25 16:27:26.969873 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept-Encoding: identity May 25 16:27:26.969873 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Connection: close May 25 16:27:26.969873 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Length: 0 May 25 16:27:26.969873 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Type: application/json May 25 16:27:26.969873 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Host: 10.222.0.42 May 25 16:27:26.969873 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Openstack-System-Scope: None May 25 16:27:26.969873 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: User-Agent: python-urllib3/1.26.9 May 25 16:27:26.969873 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Auth-Token: gAAAAABijldM9TsAZJy8dFB1DMOmN3fYD4FVUv3HZ7K9WxI11fcxXnHOFEKVQuqoz4pXUAyb9YMnHusiEz5_9NIfv66CxCRP6OYrV0TQFouqehYLNaYvAb5OzaoSF8oLgazxJMBBuxROCk5D-B6RTnZ7yadTSJVodvBMZSALenmgyavmYCv9RJ0 May 25 16:27:26.969873 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Id: None May 25 16:27:26.969873 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Name: None May 25 16:27:26.969873 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Identity-Status: Confirmed May 25 16:27:26.969873 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Is-Admin-Project: True May 25 16:27:26.969873 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Id: default May 25 16:27:26.969873 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Name: Default May 25 16:27:26.969873 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Id: 9d234edace28441282f594f0e03cacc5 May 25 16:27:26.969873 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Name: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:27:26.969873 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Role: reader,member May 25 16:27:26.969873 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Roles: reader,member May 25 16:27:26.971497 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d234edace28441282f594f0e03cacc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d234edace28441282f594f0e03cacc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d234edace28441282f594f0e03cacc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d234edace28441282f594f0e03cacc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:27:26.971497 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:27:26.971497 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Id: 9d234edace28441282f594f0e03cacc5 May 25 16:27:26.971497 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:27:26.971497 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User: tempest-AttachVolumeNegativeTest-1719621589-project May 25 16:27:26.971497 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Id: default May 25 16:27:26.971497 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Name: Default May 25 16:27:26.971497 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Id: b781c4c6cb61439fb781988a7da028ff May 25 16:27:26.971497 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Name: tempest-AttachVolumeNegativeTest-1719621589-project May 25 16:27:26.971497 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: method: > May 25 16:27:26.971497 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: exception: Instance 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 could not be found. May 25 16:27:26.971497 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: action_args: {'id': '964d7f7e-8562-42f6-80c3-cd7d03c3f1c5'} May 25 16:27:26.972432 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:27:26.972432 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:26.972432 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:27:26.972432 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:27:26.972432 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:27:26.972432 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:27:26.972432 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:27:26.972432 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:27:26.972432 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:27:26.972432 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:27:26.972432 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 could not be found. May 25 16:27:26.972432 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:26.972432 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:26.972432 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:26.972432 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:26.972432 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:26.972432 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:26.972432 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:27:26.972432 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:27:26.972432 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:27:26.973869 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:27:26.973869 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:27:26.973869 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:27:26.973869 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:27:26.973869 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:27:26.973869 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:27:26.973869 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:27:26.973869 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 could not be found. May 25 16:27:26.973869 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:26.973869 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:26.973869 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:26.973869 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:26.973869 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:26.973869 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:26.973869 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:27:26.973869 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:27:26.973869 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 could not be found. May 25 16:27:26.973869 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:26.975370 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-2dd20055-d440-4080-8283-37d8708ffc0d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Returning 404 to user: Instance 964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 could not be found. {{(pid=117510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:27:26.975370 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-2dd20055-d440-4080-8283-37d8708ffc0d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5" status: 404 len: 111 microversion: 2.1 time: 0.032447 May 25 16:27:26.975370 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 394/794] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:27:26 2022] GET /compute/v2.1/servers/964d7f7e-8562-42f6-80c3-cd7d03c3f1c5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:27:28.112044 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-c96e5a36-d518-4f49-8d19-f041c8cdfd80 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:28.112541 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-c96e5a36-d518-4f49-8d19-f041c8cdfd80 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:28.119031 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c96e5a36-d518-4f49-8d19-f041c8cdfd80 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:28.119478 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c96e5a36-d518-4f49-8d19-f041c8cdfd80 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:28.120371 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c96e5a36-d518-4f49-8d19-f041c8cdfd80 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:28.120805 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c96e5a36-d518-4f49-8d19-f041c8cdfd80 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:28.124769 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:27:28.135060 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.wsgi [None req-c96e5a36-d518-4f49-8d19-f041c8cdfd80 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] HTTP exception thrown: Instance 125fb239-87ee-4665-94f5-252ee52d73af could not be found. May 25 16:27:28.137273 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-c96e5a36-d518-4f49-8d19-f041c8cdfd80 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Request method failure captured: May 25 16:27:28.137273 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: DELETE /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af HTTP/1.1 May 25 16:27:28.137273 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:27:28.137273 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:27:28.137273 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:27:28.137273 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 0 May 25 16:27:28.137273 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:27:28.137273 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:27:28.137273 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:27:28.137273 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:27:28.137273 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijldM9TsAZJy8dFB1DMOmN3fYD4FVUv3HZ7K9WxI11fcxXnHOFEKVQuqoz4pXUAyb9YMnHusiEz5_9NIfv66CxCRP6OYrV0TQFouqehYLNaYvAb5OzaoSF8oLgazxJMBBuxROCk5D-B6RTnZ7yadTSJVodvBMZSALenmgyavmYCv9RJ0 May 25 16:27:28.137273 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:27:28.137273 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:27:28.137273 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:27:28.137273 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:27:28.137273 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:27:28.137273 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:27:28.137273 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: 9d234edace28441282f594f0e03cacc5 May 25 16:27:28.137273 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:27:28.137273 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:27:28.137273 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:27:28.138647 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d234edace28441282f594f0e03cacc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d234edace28441282f594f0e03cacc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d234edace28441282f594f0e03cacc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d234edace28441282f594f0e03cacc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:27:28.138647 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:27:28.138647 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: 9d234edace28441282f594f0e03cacc5 May 25 16:27:28.138647 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:27:28.138647 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-AttachVolumeNegativeTest-1719621589-project May 25 16:27:28.138647 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:27:28.138647 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:27:28.138647 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: b781c4c6cb61439fb781988a7da028ff May 25 16:27:28.138647 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-AttachVolumeNegativeTest-1719621589-project May 25 16:27:28.138647 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: > May 25 16:27:28.138647 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Instance 125fb239-87ee-4665-94f5-252ee52d73af could not be found. May 25 16:27:28.138647 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'id': '125fb239-87ee-4665-94f5-252ee52d73af'} May 25 16:27:28.139454 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:27:28.139454 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:28.139454 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:27:28.139454 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:27:28.139454 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:27:28.139454 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:27:28.139454 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:27:28.139454 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:27:28.139454 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:27:28.139454 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:27:28.139454 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 125fb239-87ee-4665-94f5-252ee52d73af could not be found. May 25 16:27:28.139454 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:28.139454 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:28.139454 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:28.139454 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:28.139454 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:28.139454 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:28.139454 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:27:28.139454 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:27:28.139454 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:27:28.140879 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:27:28.140879 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 16:27:28.140879 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 16:27:28.140879 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 16:27:28.140879 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 16:27:28.140879 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:27:28.140879 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:27:28.140879 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:27:28.140879 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:27:28.140879 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 125fb239-87ee-4665-94f5-252ee52d73af could not be found. May 25 16:27:28.140879 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:28.140879 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:28.140879 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:28.140879 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:28.140879 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:28.140879 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:28.140879 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:27:28.140879 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:27:28.140879 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 125fb239-87ee-4665-94f5-252ee52d73af could not be found. May 25 16:27:28.140879 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:28.142397 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-c96e5a36-d518-4f49-8d19-f041c8cdfd80 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Returning 404 to user: Instance 125fb239-87ee-4665-94f5-252ee52d73af could not be found. {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:27:28.142397 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-c96e5a36-d518-4f49-8d19-f041c8cdfd80 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "DELETE /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af" status: 404 len: 111 microversion: 2.1 time: 0.030434 May 25 16:27:28.142397 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 401/795] 10.222.0.42 () {58 vars in 1238 bytes} [Wed May 25 16:27:28 2022] DELETE /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:27:28.147113 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-23a92142-63e1-498c-ae96-a51e0a965ab2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:28.147820 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-23a92142-63e1-498c-ae96-a51e0a965ab2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 125fb239-87ee-4665-94f5-252ee52d73af] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:28.155680 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-23a92142-63e1-498c-ae96-a51e0a965ab2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:28.156133 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-23a92142-63e1-498c-ae96-a51e0a965ab2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:28.156908 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-23a92142-63e1-498c-ae96-a51e0a965ab2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:28.157345 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-23a92142-63e1-498c-ae96-a51e0a965ab2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:28.171328 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.wsgi [None req-23a92142-63e1-498c-ae96-a51e0a965ab2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] HTTP exception thrown: Instance 125fb239-87ee-4665-94f5-252ee52d73af could not be found. May 25 16:27:28.172851 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-23a92142-63e1-498c-ae96-a51e0a965ab2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Request method failure captured: May 25 16:27:28.172851 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: request: GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af HTTP/1.1 May 25 16:27:28.172851 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept: application/json May 25 16:27:28.172851 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept-Encoding: identity May 25 16:27:28.172851 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Connection: close May 25 16:27:28.172851 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Length: 0 May 25 16:27:28.172851 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Type: application/json May 25 16:27:28.172851 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Host: 10.222.0.42 May 25 16:27:28.172851 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Openstack-System-Scope: None May 25 16:27:28.172851 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: User-Agent: python-urllib3/1.26.9 May 25 16:27:28.172851 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Auth-Token: gAAAAABijldM9TsAZJy8dFB1DMOmN3fYD4FVUv3HZ7K9WxI11fcxXnHOFEKVQuqoz4pXUAyb9YMnHusiEz5_9NIfv66CxCRP6OYrV0TQFouqehYLNaYvAb5OzaoSF8oLgazxJMBBuxROCk5D-B6RTnZ7yadTSJVodvBMZSALenmgyavmYCv9RJ0 May 25 16:27:28.172851 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Id: None May 25 16:27:28.172851 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Name: None May 25 16:27:28.172851 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Identity-Status: Confirmed May 25 16:27:28.172851 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Is-Admin-Project: True May 25 16:27:28.172851 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Id: default May 25 16:27:28.172851 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Name: Default May 25 16:27:28.172851 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Id: 9d234edace28441282f594f0e03cacc5 May 25 16:27:28.172851 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Name: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:27:28.172851 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Role: reader,member May 25 16:27:28.172851 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Roles: reader,member May 25 16:27:28.174466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d234edace28441282f594f0e03cacc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d234edace28441282f594f0e03cacc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d234edace28441282f594f0e03cacc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d234edace28441282f594f0e03cacc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:27:28.174466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:27:28.174466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Id: 9d234edace28441282f594f0e03cacc5 May 25 16:27:28.174466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:27:28.174466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User: tempest-AttachVolumeNegativeTest-1719621589-project May 25 16:27:28.174466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Id: default May 25 16:27:28.174466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Name: Default May 25 16:27:28.174466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Id: b781c4c6cb61439fb781988a7da028ff May 25 16:27:28.174466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Name: tempest-AttachVolumeNegativeTest-1719621589-project May 25 16:27:28.174466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: method: > May 25 16:27:28.174466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: exception: Instance 125fb239-87ee-4665-94f5-252ee52d73af could not be found. May 25 16:27:28.174466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: action_args: {'id': '125fb239-87ee-4665-94f5-252ee52d73af'} May 25 16:27:28.175529 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:27:28.175529 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:28.175529 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:27:28.175529 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:27:28.175529 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:27:28.175529 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:27:28.175529 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:27:28.175529 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:27:28.175529 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:27:28.175529 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:27:28.175529 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 125fb239-87ee-4665-94f5-252ee52d73af could not be found. May 25 16:27:28.175529 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:28.175529 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:28.175529 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:28.175529 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:28.175529 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:28.175529 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:28.175529 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:27:28.175529 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:27:28.175529 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:27:28.177038 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:27:28.177038 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:27:28.177038 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:27:28.177038 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:27:28.177038 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:27:28.177038 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:27:28.177038 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:27:28.177038 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 125fb239-87ee-4665-94f5-252ee52d73af could not be found. May 25 16:27:28.177038 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:28.177038 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:28.177038 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:28.177038 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:28.177038 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:28.177038 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:28.177038 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:27:28.177038 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:27:28.177038 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 125fb239-87ee-4665-94f5-252ee52d73af could not be found. May 25 16:27:28.177038 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:28.178456 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-23a92142-63e1-498c-ae96-a51e0a965ab2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Returning 404 to user: Instance 125fb239-87ee-4665-94f5-252ee52d73af could not be found. {{(pid=117510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:27:28.178456 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-23a92142-63e1-498c-ae96-a51e0a965ab2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af" status: 404 len: 111 microversion: 2.1 time: 0.030961 May 25 16:27:28.178456 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 395/796] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:27:28 2022] GET /compute/v2.1/servers/125fb239-87ee-4665-94f5-252ee52d73af => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:27:28.183471 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-537e0902-f115-40cf-8045-76d54907b3a2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:28.183972 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-537e0902-f115-40cf-8045-76d54907b3a2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 867f3a7b-7e7e-468a-b1a3-9c71cc196f23] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:28.191150 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-537e0902-f115-40cf-8045-76d54907b3a2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:28.191597 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-537e0902-f115-40cf-8045-76d54907b3a2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:28.192359 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-537e0902-f115-40cf-8045-76d54907b3a2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:28.192796 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-537e0902-f115-40cf-8045-76d54907b3a2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:28.206863 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.wsgi [None req-537e0902-f115-40cf-8045-76d54907b3a2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] HTTP exception thrown: Instance 867f3a7b-7e7e-468a-b1a3-9c71cc196f23 could not be found. May 25 16:27:28.208371 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-537e0902-f115-40cf-8045-76d54907b3a2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Request method failure captured: May 25 16:27:28.208371 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: DELETE /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23 HTTP/1.1 May 25 16:27:28.208371 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:27:28.208371 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:27:28.208371 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:27:28.208371 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 0 May 25 16:27:28.208371 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:27:28.208371 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:27:28.208371 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:27:28.208371 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:27:28.208371 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijldM9TsAZJy8dFB1DMOmN3fYD4FVUv3HZ7K9WxI11fcxXnHOFEKVQuqoz4pXUAyb9YMnHusiEz5_9NIfv66CxCRP6OYrV0TQFouqehYLNaYvAb5OzaoSF8oLgazxJMBBuxROCk5D-B6RTnZ7yadTSJVodvBMZSALenmgyavmYCv9RJ0 May 25 16:27:28.208371 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:27:28.208371 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:27:28.208371 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:27:28.208371 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:27:28.208371 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:27:28.208371 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:27:28.208371 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: 9d234edace28441282f594f0e03cacc5 May 25 16:27:28.208371 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:27:28.208371 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:27:28.208371 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:27:28.209916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d234edace28441282f594f0e03cacc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d234edace28441282f594f0e03cacc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d234edace28441282f594f0e03cacc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d234edace28441282f594f0e03cacc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:27:28.209916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:27:28.209916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: 9d234edace28441282f594f0e03cacc5 May 25 16:27:28.209916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:27:28.209916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-AttachVolumeNegativeTest-1719621589-project May 25 16:27:28.209916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:27:28.209916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:27:28.209916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: b781c4c6cb61439fb781988a7da028ff May 25 16:27:28.209916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-AttachVolumeNegativeTest-1719621589-project May 25 16:27:28.209916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: > May 25 16:27:28.209916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Instance 867f3a7b-7e7e-468a-b1a3-9c71cc196f23 could not be found. May 25 16:27:28.209916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'id': '867f3a7b-7e7e-468a-b1a3-9c71cc196f23'} May 25 16:27:28.210796 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:27:28.210796 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:28.210796 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:27:28.210796 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:27:28.210796 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:27:28.210796 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:27:28.210796 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:27:28.210796 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:27:28.210796 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:27:28.210796 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:27:28.210796 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 867f3a7b-7e7e-468a-b1a3-9c71cc196f23 could not be found. May 25 16:27:28.210796 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:28.210796 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:28.210796 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:28.210796 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:28.210796 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:28.210796 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:28.210796 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:27:28.210796 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:27:28.210796 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:27:28.212234 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:27:28.212234 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 16:27:28.212234 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 16:27:28.212234 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 16:27:28.212234 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 16:27:28.212234 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:27:28.212234 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:27:28.212234 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:27:28.212234 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:27:28.212234 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 867f3a7b-7e7e-468a-b1a3-9c71cc196f23 could not be found. May 25 16:27:28.212234 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:28.212234 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:28.212234 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:28.212234 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:28.212234 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:28.212234 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:28.212234 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:27:28.212234 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:27:28.212234 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 867f3a7b-7e7e-468a-b1a3-9c71cc196f23 could not be found. May 25 16:27:28.212234 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:28.218839 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-537e0902-f115-40cf-8045-76d54907b3a2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Returning 404 to user: Instance 867f3a7b-7e7e-468a-b1a3-9c71cc196f23 could not be found. {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:27:28.218839 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-537e0902-f115-40cf-8045-76d54907b3a2 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "DELETE /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23" status: 404 len: 111 microversion: 2.1 time: 0.030717 May 25 16:27:28.218839 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 402/797] 10.222.0.42 () {58 vars in 1238 bytes} [Wed May 25 16:27:28 2022] DELETE /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:27:28.219123 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-07d9d478-99ef-41e0-a073-d883424f421d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:28.219123 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-07d9d478-99ef-41e0-a073-d883424f421d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: 867f3a7b-7e7e-468a-b1a3-9c71cc196f23] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:28.224800 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-07d9d478-99ef-41e0-a073-d883424f421d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:28.225252 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-07d9d478-99ef-41e0-a073-d883424f421d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:28.226070 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-07d9d478-99ef-41e0-a073-d883424f421d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:28.226510 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-07d9d478-99ef-41e0-a073-d883424f421d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:28.239864 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.wsgi [None req-07d9d478-99ef-41e0-a073-d883424f421d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] HTTP exception thrown: Instance 867f3a7b-7e7e-468a-b1a3-9c71cc196f23 could not be found. May 25 16:27:28.241349 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-07d9d478-99ef-41e0-a073-d883424f421d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Request method failure captured: May 25 16:27:28.241349 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: request: GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23 HTTP/1.1 May 25 16:27:28.241349 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept: application/json May 25 16:27:28.241349 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept-Encoding: identity May 25 16:27:28.241349 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Connection: close May 25 16:27:28.241349 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Length: 0 May 25 16:27:28.241349 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Type: application/json May 25 16:27:28.241349 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Host: 10.222.0.42 May 25 16:27:28.241349 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Openstack-System-Scope: None May 25 16:27:28.241349 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: User-Agent: python-urllib3/1.26.9 May 25 16:27:28.241349 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Auth-Token: gAAAAABijldM9TsAZJy8dFB1DMOmN3fYD4FVUv3HZ7K9WxI11fcxXnHOFEKVQuqoz4pXUAyb9YMnHusiEz5_9NIfv66CxCRP6OYrV0TQFouqehYLNaYvAb5OzaoSF8oLgazxJMBBuxROCk5D-B6RTnZ7yadTSJVodvBMZSALenmgyavmYCv9RJ0 May 25 16:27:28.241349 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Id: None May 25 16:27:28.241349 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Name: None May 25 16:27:28.241349 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Identity-Status: Confirmed May 25 16:27:28.241349 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Is-Admin-Project: True May 25 16:27:28.241349 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Id: default May 25 16:27:28.241349 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Name: Default May 25 16:27:28.241349 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Id: 9d234edace28441282f594f0e03cacc5 May 25 16:27:28.241349 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Name: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:27:28.241349 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Role: reader,member May 25 16:27:28.241349 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Roles: reader,member May 25 16:27:28.242914 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d234edace28441282f594f0e03cacc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d234edace28441282f594f0e03cacc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d234edace28441282f594f0e03cacc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d234edace28441282f594f0e03cacc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:27:28.242914 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:27:28.242914 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Id: 9d234edace28441282f594f0e03cacc5 May 25 16:27:28.242914 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:27:28.242914 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User: tempest-AttachVolumeNegativeTest-1719621589-project May 25 16:27:28.242914 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Id: default May 25 16:27:28.242914 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Name: Default May 25 16:27:28.242914 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Id: b781c4c6cb61439fb781988a7da028ff May 25 16:27:28.242914 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Name: tempest-AttachVolumeNegativeTest-1719621589-project May 25 16:27:28.242914 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: method: > May 25 16:27:28.242914 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: exception: Instance 867f3a7b-7e7e-468a-b1a3-9c71cc196f23 could not be found. May 25 16:27:28.242914 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: action_args: {'id': '867f3a7b-7e7e-468a-b1a3-9c71cc196f23'} May 25 16:27:28.244481 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:27:28.244481 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:28.244481 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:27:28.244481 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:27:28.244481 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:27:28.244481 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:27:28.244481 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:27:28.244481 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:27:28.244481 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:27:28.244481 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:27:28.244481 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 867f3a7b-7e7e-468a-b1a3-9c71cc196f23 could not be found. May 25 16:27:28.244481 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:28.244481 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:28.244481 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:28.244481 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:28.244481 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:28.244481 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:28.244481 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:27:28.244481 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:27:28.244481 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:27:28.246781 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:27:28.246781 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:27:28.246781 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:27:28.246781 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:27:28.246781 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:27:28.246781 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:27:28.246781 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:27:28.246781 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 867f3a7b-7e7e-468a-b1a3-9c71cc196f23 could not be found. May 25 16:27:28.246781 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:28.246781 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:28.246781 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:28.246781 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:28.246781 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:28.246781 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:28.246781 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:27:28.246781 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:27:28.246781 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 867f3a7b-7e7e-468a-b1a3-9c71cc196f23 could not be found. May 25 16:27:28.246781 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:28.247852 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-07d9d478-99ef-41e0-a073-d883424f421d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Returning 404 to user: Instance 867f3a7b-7e7e-468a-b1a3-9c71cc196f23 could not be found. {{(pid=117510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:27:28.247852 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-07d9d478-99ef-41e0-a073-d883424f421d tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23" status: 404 len: 111 microversion: 2.1 time: 0.028217 May 25 16:27:28.247852 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 396/798] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:27:28 2022] GET /compute/v2.1/servers/867f3a7b-7e7e-468a-b1a3-9c71cc196f23 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:27:28.349317 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-36bbcd3a-0e06-4491-b268-d74573dec3d1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:28.349852 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-36bbcd3a-0e06-4491-b268-d74573dec3d1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:28.355890 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-36bbcd3a-0e06-4491-b268-d74573dec3d1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:28.356337 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-36bbcd3a-0e06-4491-b268-d74573dec3d1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:28.357118 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-36bbcd3a-0e06-4491-b268-d74573dec3d1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:28.357556 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-36bbcd3a-0e06-4491-b268-d74573dec3d1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:28.371506 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.wsgi [None req-36bbcd3a-0e06-4491-b268-d74573dec3d1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] HTTP exception thrown: Instance 50c1e1a5-ce7f-4032-b028-431051dfde44 could not be found. May 25 16:27:28.373010 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-36bbcd3a-0e06-4491-b268-d74573dec3d1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Request method failure captured: May 25 16:27:28.373010 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: DELETE /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44 HTTP/1.1 May 25 16:27:28.373010 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:27:28.373010 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:27:28.373010 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:27:28.373010 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 0 May 25 16:27:28.373010 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:27:28.373010 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:27:28.373010 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:27:28.373010 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:27:28.373010 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijldXnJWiX7WFaRzhSEZJEpgFMy11by1fa61p9fQ2_iYXx_dOqUEpT-Xfhu8XvnV5IAA4PJl4j2v3l07QABoVYuYSBM3EOpnApdVO5VSaVNlYF1RGhdi0o4Y57dwP6pzcSNOaGdIhQeVOY8MKMXsXB0pJHoem7prbNsejF47pgT8V-yg May 25 16:27:28.373010 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:27:28.373010 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:27:28.373010 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:27:28.373010 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:27:28.373010 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:27:28.373010 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:27:28.373010 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: 3e8c39550e4e41e79cc56aa7d22ae052 May 25 16:27:28.373010 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-AttachVolumeTestJSON-1756534258 May 25 16:27:28.373010 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:27:28.373010 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:27:28.374637 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e8c39550e4e41e79cc56aa7d22ae052"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3e8c39550e4e41e79cc56aa7d22ae052"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3e8c39550e4e41e79cc56aa7d22ae052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e8c39550e4e41e79cc56aa7d22ae052"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:27:28.374637 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-AttachVolumeTestJSON-1756534258 May 25 16:27:28.374637 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: 3e8c39550e4e41e79cc56aa7d22ae052 May 25 16:27:28.374637 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1756534258 May 25 16:27:28.374637 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-AttachVolumeTestJSON-1756534258-project May 25 16:27:28.374637 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:27:28.374637 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:27:28.374637 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: 15fae427f22d476fa0e378949de41292 May 25 16:27:28.374637 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-AttachVolumeTestJSON-1756534258-project May 25 16:27:28.374637 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: > May 25 16:27:28.374637 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Instance 50c1e1a5-ce7f-4032-b028-431051dfde44 could not be found. May 25 16:27:28.374637 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'id': '50c1e1a5-ce7f-4032-b028-431051dfde44'} May 25 16:27:28.375603 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:27:28.375603 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:28.375603 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:27:28.375603 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:27:28.375603 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:27:28.375603 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:27:28.375603 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:27:28.375603 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:27:28.375603 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:27:28.375603 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:27:28.375603 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50c1e1a5-ce7f-4032-b028-431051dfde44 could not be found. May 25 16:27:28.375603 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:28.375603 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:28.375603 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:28.375603 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:28.375603 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:28.375603 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:28.375603 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:27:28.375603 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:27:28.375603 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:27:28.377087 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:27:28.377087 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 16:27:28.377087 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 16:27:28.377087 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 16:27:28.377087 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 16:27:28.377087 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:27:28.377087 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:27:28.377087 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:27:28.377087 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:27:28.377087 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50c1e1a5-ce7f-4032-b028-431051dfde44 could not be found. May 25 16:27:28.377087 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:28.377087 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:28.377087 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:28.377087 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:28.377087 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:28.377087 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:28.377087 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:27:28.377087 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:27:28.377087 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50c1e1a5-ce7f-4032-b028-431051dfde44 could not be found. May 25 16:27:28.377087 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:28.379046 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-36bbcd3a-0e06-4491-b268-d74573dec3d1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Returning 404 to user: Instance 50c1e1a5-ce7f-4032-b028-431051dfde44 could not be found. {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:27:28.379046 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-36bbcd3a-0e06-4491-b268-d74573dec3d1 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "DELETE /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44" status: 404 len: 111 microversion: 2.1 time: 0.033163 May 25 16:27:28.379046 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 403/799] 10.222.0.42 () {58 vars in 1238 bytes} [Wed May 25 16:27:28 2022] DELETE /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:27:28.382870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-b745abb9-9159-49ad-94af-c374c06290f5 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:28.383467 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-b745abb9-9159-49ad-94af-c374c06290f5 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 50c1e1a5-ce7f-4032-b028-431051dfde44] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:28.390635 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b745abb9-9159-49ad-94af-c374c06290f5 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:28.391078 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b745abb9-9159-49ad-94af-c374c06290f5 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:28.391822 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b745abb9-9159-49ad-94af-c374c06290f5 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:28.392252 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b745abb9-9159-49ad-94af-c374c06290f5 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:28.405486 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.wsgi [None req-b745abb9-9159-49ad-94af-c374c06290f5 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] HTTP exception thrown: Instance 50c1e1a5-ce7f-4032-b028-431051dfde44 could not be found. May 25 16:27:28.407001 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-b745abb9-9159-49ad-94af-c374c06290f5 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Request method failure captured: May 25 16:27:28.407001 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: request: GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44 HTTP/1.1 May 25 16:27:28.407001 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept: application/json May 25 16:27:28.407001 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept-Encoding: identity May 25 16:27:28.407001 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Connection: close May 25 16:27:28.407001 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Length: 0 May 25 16:27:28.407001 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Type: application/json May 25 16:27:28.407001 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Host: 10.222.0.42 May 25 16:27:28.407001 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Openstack-System-Scope: None May 25 16:27:28.407001 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: User-Agent: python-urllib3/1.26.9 May 25 16:27:28.407001 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Auth-Token: gAAAAABijldXnJWiX7WFaRzhSEZJEpgFMy11by1fa61p9fQ2_iYXx_dOqUEpT-Xfhu8XvnV5IAA4PJl4j2v3l07QABoVYuYSBM3EOpnApdVO5VSaVNlYF1RGhdi0o4Y57dwP6pzcSNOaGdIhQeVOY8MKMXsXB0pJHoem7prbNsejF47pgT8V-yg May 25 16:27:28.407001 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Id: None May 25 16:27:28.407001 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Name: None May 25 16:27:28.407001 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Identity-Status: Confirmed May 25 16:27:28.407001 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Is-Admin-Project: True May 25 16:27:28.407001 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Id: default May 25 16:27:28.407001 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Name: Default May 25 16:27:28.407001 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Id: 3e8c39550e4e41e79cc56aa7d22ae052 May 25 16:27:28.407001 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Name: tempest-AttachVolumeTestJSON-1756534258 May 25 16:27:28.407001 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Role: reader,member May 25 16:27:28.407001 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Roles: reader,member May 25 16:27:28.408474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e8c39550e4e41e79cc56aa7d22ae052"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3e8c39550e4e41e79cc56aa7d22ae052"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3e8c39550e4e41e79cc56aa7d22ae052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e8c39550e4e41e79cc56aa7d22ae052"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:27:28.408474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant: tempest-AttachVolumeTestJSON-1756534258 May 25 16:27:28.408474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Id: 3e8c39550e4e41e79cc56aa7d22ae052 May 25 16:27:28.408474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1756534258 May 25 16:27:28.408474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User: tempest-AttachVolumeTestJSON-1756534258-project May 25 16:27:28.408474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Id: default May 25 16:27:28.408474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Name: Default May 25 16:27:28.408474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Id: 15fae427f22d476fa0e378949de41292 May 25 16:27:28.408474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Name: tempest-AttachVolumeTestJSON-1756534258-project May 25 16:27:28.408474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: method: > May 25 16:27:28.408474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: exception: Instance 50c1e1a5-ce7f-4032-b028-431051dfde44 could not be found. May 25 16:27:28.408474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: action_args: {'id': '50c1e1a5-ce7f-4032-b028-431051dfde44'} May 25 16:27:28.412556 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:27:28.412556 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:28.412556 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:27:28.412556 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:27:28.412556 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:27:28.412556 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:27:28.412556 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:27:28.412556 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:27:28.412556 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:27:28.412556 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:27:28.412556 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50c1e1a5-ce7f-4032-b028-431051dfde44 could not be found. May 25 16:27:28.412556 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:28.412556 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:28.412556 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:28.412556 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:28.412556 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:28.412556 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:28.412556 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:27:28.412556 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:27:28.412556 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:27:28.414006 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:27:28.414006 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:27:28.414006 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:27:28.414006 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:27:28.414006 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:27:28.414006 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:27:28.414006 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:27:28.414006 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50c1e1a5-ce7f-4032-b028-431051dfde44 could not be found. May 25 16:27:28.414006 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:28.414006 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:28.414006 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:28.414006 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:28.414006 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:28.414006 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:28.414006 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:27:28.414006 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:27:28.414006 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50c1e1a5-ce7f-4032-b028-431051dfde44 could not be found. May 25 16:27:28.414006 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:28.415394 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-b745abb9-9159-49ad-94af-c374c06290f5 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Returning 404 to user: Instance 50c1e1a5-ce7f-4032-b028-431051dfde44 could not be found. {{(pid=117510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:27:28.415394 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-b745abb9-9159-49ad-94af-c374c06290f5 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44" status: 404 len: 111 microversion: 2.1 time: 0.029358 May 25 16:27:28.415394 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 397/800] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:27:28 2022] GET /compute/v2.1/servers/50c1e1a5-ce7f-4032-b028-431051dfde44 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:27:29.380161 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-33b53272-b118-4395-a7d6-131ccb734171 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:29.380802 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-33b53272-b118-4395-a7d6-131ccb734171 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:29.387320 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-33b53272-b118-4395-a7d6-131ccb734171 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:29.387774 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-33b53272-b118-4395-a7d6-131ccb734171 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:29.388508 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-33b53272-b118-4395-a7d6-131ccb734171 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:29.388937 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-33b53272-b118-4395-a7d6-131ccb734171 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:29.402097 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.wsgi [None req-33b53272-b118-4395-a7d6-131ccb734171 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] HTTP exception thrown: Instance cebf1f03-8c0a-4aaf-b375-63edcdac9d98 could not be found. May 25 16:27:29.403605 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-33b53272-b118-4395-a7d6-131ccb734171 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Request method failure captured: May 25 16:27:29.403605 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: DELETE /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 HTTP/1.1 May 25 16:27:29.403605 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:27:29.403605 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:27:29.403605 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:27:29.403605 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 0 May 25 16:27:29.403605 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:27:29.403605 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:27:29.403605 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:27:29.403605 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:27:29.403605 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijldM9TsAZJy8dFB1DMOmN3fYD4FVUv3HZ7K9WxI11fcxXnHOFEKVQuqoz4pXUAyb9YMnHusiEz5_9NIfv66CxCRP6OYrV0TQFouqehYLNaYvAb5OzaoSF8oLgazxJMBBuxROCk5D-B6RTnZ7yadTSJVodvBMZSALenmgyavmYCv9RJ0 May 25 16:27:29.403605 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:27:29.403605 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:27:29.403605 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:27:29.403605 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:27:29.403605 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:27:29.403605 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:27:29.403605 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: 9d234edace28441282f594f0e03cacc5 May 25 16:27:29.403605 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:27:29.403605 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:27:29.403605 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:27:29.405243 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d234edace28441282f594f0e03cacc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d234edace28441282f594f0e03cacc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d234edace28441282f594f0e03cacc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d234edace28441282f594f0e03cacc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:27:29.405243 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:27:29.405243 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: 9d234edace28441282f594f0e03cacc5 May 25 16:27:29.405243 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:27:29.405243 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-AttachVolumeNegativeTest-1719621589-project May 25 16:27:29.405243 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:27:29.405243 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:27:29.405243 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: b781c4c6cb61439fb781988a7da028ff May 25 16:27:29.405243 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-AttachVolumeNegativeTest-1719621589-project May 25 16:27:29.405243 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: > May 25 16:27:29.405243 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Instance cebf1f03-8c0a-4aaf-b375-63edcdac9d98 could not be found. May 25 16:27:29.405243 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'id': 'cebf1f03-8c0a-4aaf-b375-63edcdac9d98'} May 25 16:27:29.406429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:27:29.406429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:29.406429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:27:29.406429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:27:29.406429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:27:29.406429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:27:29.406429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:27:29.406429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:27:29.406429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:27:29.406429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:27:29.406429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cebf1f03-8c0a-4aaf-b375-63edcdac9d98 could not be found. May 25 16:27:29.406429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:29.406429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:29.406429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:29.406429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:29.406429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:29.406429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:29.406429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:27:29.406429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:27:29.406429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:27:29.407907 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:27:29.407907 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 16:27:29.407907 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 16:27:29.407907 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 16:27:29.407907 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 16:27:29.407907 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:27:29.407907 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:27:29.407907 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:27:29.407907 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:27:29.407907 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cebf1f03-8c0a-4aaf-b375-63edcdac9d98 could not be found. May 25 16:27:29.407907 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:29.407907 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:29.407907 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:29.407907 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:29.407907 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:29.407907 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:29.407907 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:27:29.407907 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:27:29.407907 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cebf1f03-8c0a-4aaf-b375-63edcdac9d98 could not be found. May 25 16:27:29.407907 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:29.409417 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-33b53272-b118-4395-a7d6-131ccb734171 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Returning 404 to user: Instance cebf1f03-8c0a-4aaf-b375-63edcdac9d98 could not be found. {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:27:29.409417 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-33b53272-b118-4395-a7d6-131ccb734171 tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98" status: 404 len: 111 microversion: 2.1 time: 0.028595 May 25 16:27:29.409417 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 404/801] 10.222.0.42 () {58 vars in 1238 bytes} [Wed May 25 16:27:29 2022] DELETE /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:27:29.413406 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-ee8a385c-553b-4c30-a620-3c478e605b4a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:29.414039 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-ee8a385c-553b-4c30-a620-3c478e605b4a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] [instance: cebf1f03-8c0a-4aaf-b375-63edcdac9d98] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:29.420996 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ee8a385c-553b-4c30-a620-3c478e605b4a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:29.421442 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ee8a385c-553b-4c30-a620-3c478e605b4a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:29.422233 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ee8a385c-553b-4c30-a620-3c478e605b4a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:29.422668 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ee8a385c-553b-4c30-a620-3c478e605b4a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:29.436972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.wsgi [None req-ee8a385c-553b-4c30-a620-3c478e605b4a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] HTTP exception thrown: Instance cebf1f03-8c0a-4aaf-b375-63edcdac9d98 could not be found. May 25 16:27:29.438528 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-ee8a385c-553b-4c30-a620-3c478e605b4a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Request method failure captured: May 25 16:27:29.438528 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: request: GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 HTTP/1.1 May 25 16:27:29.438528 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept: application/json May 25 16:27:29.438528 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept-Encoding: identity May 25 16:27:29.438528 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Connection: close May 25 16:27:29.438528 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Length: 0 May 25 16:27:29.438528 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Type: application/json May 25 16:27:29.438528 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Host: 10.222.0.42 May 25 16:27:29.438528 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Openstack-System-Scope: None May 25 16:27:29.438528 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: User-Agent: python-urllib3/1.26.9 May 25 16:27:29.438528 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Auth-Token: gAAAAABijldM9TsAZJy8dFB1DMOmN3fYD4FVUv3HZ7K9WxI11fcxXnHOFEKVQuqoz4pXUAyb9YMnHusiEz5_9NIfv66CxCRP6OYrV0TQFouqehYLNaYvAb5OzaoSF8oLgazxJMBBuxROCk5D-B6RTnZ7yadTSJVodvBMZSALenmgyavmYCv9RJ0 May 25 16:27:29.438528 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Id: None May 25 16:27:29.438528 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Name: None May 25 16:27:29.438528 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Identity-Status: Confirmed May 25 16:27:29.438528 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Is-Admin-Project: True May 25 16:27:29.438528 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Id: default May 25 16:27:29.438528 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Name: Default May 25 16:27:29.438528 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Id: 9d234edace28441282f594f0e03cacc5 May 25 16:27:29.438528 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Name: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:27:29.438528 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Role: reader,member May 25 16:27:29.438528 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Roles: reader,member May 25 16:27:29.440129 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d234edace28441282f594f0e03cacc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d234edace28441282f594f0e03cacc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d234edace28441282f594f0e03cacc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d234edace28441282f594f0e03cacc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:27:29.440129 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:27:29.440129 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Id: 9d234edace28441282f594f0e03cacc5 May 25 16:27:29.440129 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1719621589 May 25 16:27:29.440129 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User: tempest-AttachVolumeNegativeTest-1719621589-project May 25 16:27:29.440129 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Id: default May 25 16:27:29.440129 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Name: Default May 25 16:27:29.440129 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Id: b781c4c6cb61439fb781988a7da028ff May 25 16:27:29.440129 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Name: tempest-AttachVolumeNegativeTest-1719621589-project May 25 16:27:29.440129 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: method: > May 25 16:27:29.440129 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: exception: Instance cebf1f03-8c0a-4aaf-b375-63edcdac9d98 could not be found. May 25 16:27:29.440129 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: action_args: {'id': 'cebf1f03-8c0a-4aaf-b375-63edcdac9d98'} May 25 16:27:29.440975 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:27:29.440975 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:29.440975 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:27:29.440975 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:27:29.440975 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:27:29.440975 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:27:29.440975 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:27:29.440975 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:27:29.440975 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:27:29.440975 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:27:29.440975 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cebf1f03-8c0a-4aaf-b375-63edcdac9d98 could not be found. May 25 16:27:29.440975 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:29.440975 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:29.440975 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:29.440975 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:29.440975 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:29.440975 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:29.440975 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:27:29.440975 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:27:29.440975 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:27:29.442454 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:27:29.442454 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:27:29.442454 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:27:29.442454 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:27:29.442454 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:27:29.442454 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:27:29.442454 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:27:29.442454 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cebf1f03-8c0a-4aaf-b375-63edcdac9d98 could not be found. May 25 16:27:29.442454 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:29.442454 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:29.442454 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:29.442454 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:29.442454 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:29.442454 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:29.442454 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:27:29.442454 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:27:29.442454 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cebf1f03-8c0a-4aaf-b375-63edcdac9d98 could not be found. May 25 16:27:29.442454 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:29.443695 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-ee8a385c-553b-4c30-a620-3c478e605b4a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] Returning 404 to user: Instance cebf1f03-8c0a-4aaf-b375-63edcdac9d98 could not be found. {{(pid=117510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:27:29.443695 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-ee8a385c-553b-4c30-a620-3c478e605b4a tempest-AttachVolumeNegativeTest-1719621589 tempest-AttachVolumeNegativeTest-1719621589-project] 10.222.0.42 "GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98" status: 404 len: 111 microversion: 2.1 time: 0.030545 May 25 16:27:29.443695 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 398/802] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:27:29 2022] GET /compute/v2.1/servers/cebf1f03-8c0a-4aaf-b375-63edcdac9d98 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 16:27:29.546048 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-ce92563e-233b-4014-9ad2-3524e0560dc0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:29.546609 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-ce92563e-233b-4014-9ad2-3524e0560dc0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:29.552584 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ce92563e-233b-4014-9ad2-3524e0560dc0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:29.553024 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ce92563e-233b-4014-9ad2-3524e0560dc0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:29.553787 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ce92563e-233b-4014-9ad2-3524e0560dc0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:29.554221 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ce92563e-233b-4014-9ad2-3524e0560dc0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:29.570335 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.wsgi [None req-ce92563e-233b-4014-9ad2-3524e0560dc0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] HTTP exception thrown: Instance 9c525fad-3e59-4bcd-9263-cf3a13d13e3f could not be found. May 25 16:27:29.571866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-ce92563e-233b-4014-9ad2-3524e0560dc0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Request method failure captured: May 25 16:27:29.571866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: DELETE /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f HTTP/1.1 May 25 16:27:29.571866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:27:29.571866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:27:29.571866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:27:29.571866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 0 May 25 16:27:29.571866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:27:29.571866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:27:29.571866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:27:29.571866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:27:29.571866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijldXnJWiX7WFaRzhSEZJEpgFMy11by1fa61p9fQ2_iYXx_dOqUEpT-Xfhu8XvnV5IAA4PJl4j2v3l07QABoVYuYSBM3EOpnApdVO5VSaVNlYF1RGhdi0o4Y57dwP6pzcSNOaGdIhQeVOY8MKMXsXB0pJHoem7prbNsejF47pgT8V-yg May 25 16:27:29.571866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:27:29.571866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:27:29.571866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:27:29.571866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:27:29.571866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:27:29.571866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:27:29.571866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: 3e8c39550e4e41e79cc56aa7d22ae052 May 25 16:27:29.571866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-AttachVolumeTestJSON-1756534258 May 25 16:27:29.571866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:27:29.571866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:27:29.573365 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e8c39550e4e41e79cc56aa7d22ae052"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3e8c39550e4e41e79cc56aa7d22ae052"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3e8c39550e4e41e79cc56aa7d22ae052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e8c39550e4e41e79cc56aa7d22ae052"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:27:29.573365 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-AttachVolumeTestJSON-1756534258 May 25 16:27:29.573365 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: 3e8c39550e4e41e79cc56aa7d22ae052 May 25 16:27:29.573365 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1756534258 May 25 16:27:29.573365 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-AttachVolumeTestJSON-1756534258-project May 25 16:27:29.573365 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:27:29.573365 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:27:29.573365 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: 15fae427f22d476fa0e378949de41292 May 25 16:27:29.573365 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-AttachVolumeTestJSON-1756534258-project May 25 16:27:29.573365 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: > May 25 16:27:29.573365 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Instance 9c525fad-3e59-4bcd-9263-cf3a13d13e3f could not be found. May 25 16:27:29.573365 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'id': '9c525fad-3e59-4bcd-9263-cf3a13d13e3f'} May 25 16:27:29.574189 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:27:29.574189 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:29.574189 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:27:29.574189 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:27:29.574189 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:27:29.574189 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:27:29.574189 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:27:29.574189 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:27:29.574189 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:27:29.574189 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:27:29.574189 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c525fad-3e59-4bcd-9263-cf3a13d13e3f could not be found. May 25 16:27:29.574189 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:29.574189 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:29.574189 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:29.574189 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:29.574189 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:29.574189 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:29.574189 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:27:29.574189 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:27:29.574189 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:27:29.575821 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:27:29.575821 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 16:27:29.575821 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 16:27:29.575821 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 16:27:29.575821 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 16:27:29.575821 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:27:29.575821 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:27:29.575821 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:27:29.575821 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:27:29.575821 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c525fad-3e59-4bcd-9263-cf3a13d13e3f could not be found. May 25 16:27:29.575821 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:29.575821 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:29.575821 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:29.575821 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:29.575821 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:29.575821 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:29.575821 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:27:29.575821 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:27:29.575821 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c525fad-3e59-4bcd-9263-cf3a13d13e3f could not be found. May 25 16:27:29.575821 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:29.577517 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-ce92563e-233b-4014-9ad2-3524e0560dc0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Returning 404 to user: Instance 9c525fad-3e59-4bcd-9263-cf3a13d13e3f could not be found. {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:27:29.577517 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-ce92563e-233b-4014-9ad2-3524e0560dc0 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 404 len: 111 microversion: 2.1 time: 0.031862 May 25 16:27:29.577517 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 405/803] 10.222.0.42 () {58 vars in 1238 bytes} [Wed May 25 16:27:29 2022] DELETE /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:27:29.582339 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-4512739c-4cda-44c2-a129-47a78ef89289 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:29.582972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-4512739c-4cda-44c2-a129-47a78ef89289 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] [instance: 9c525fad-3e59-4bcd-9263-cf3a13d13e3f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:29.589112 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4512739c-4cda-44c2-a129-47a78ef89289 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:29.589778 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4512739c-4cda-44c2-a129-47a78ef89289 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:29.590541 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4512739c-4cda-44c2-a129-47a78ef89289 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:29.590975 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4512739c-4cda-44c2-a129-47a78ef89289 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:29.606514 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.wsgi [None req-4512739c-4cda-44c2-a129-47a78ef89289 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] HTTP exception thrown: Instance 9c525fad-3e59-4bcd-9263-cf3a13d13e3f could not be found. May 25 16:27:29.608043 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-4512739c-4cda-44c2-a129-47a78ef89289 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Request method failure captured: May 25 16:27:29.608043 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: request: GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f HTTP/1.1 May 25 16:27:29.608043 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept: application/json May 25 16:27:29.608043 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept-Encoding: identity May 25 16:27:29.608043 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Connection: close May 25 16:27:29.608043 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Length: 0 May 25 16:27:29.608043 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Type: application/json May 25 16:27:29.608043 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Host: 10.222.0.42 May 25 16:27:29.608043 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Openstack-System-Scope: None May 25 16:27:29.608043 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: User-Agent: python-urllib3/1.26.9 May 25 16:27:29.608043 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Auth-Token: gAAAAABijldXnJWiX7WFaRzhSEZJEpgFMy11by1fa61p9fQ2_iYXx_dOqUEpT-Xfhu8XvnV5IAA4PJl4j2v3l07QABoVYuYSBM3EOpnApdVO5VSaVNlYF1RGhdi0o4Y57dwP6pzcSNOaGdIhQeVOY8MKMXsXB0pJHoem7prbNsejF47pgT8V-yg May 25 16:27:29.608043 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Id: None May 25 16:27:29.608043 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Name: None May 25 16:27:29.608043 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Identity-Status: Confirmed May 25 16:27:29.608043 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Is-Admin-Project: True May 25 16:27:29.608043 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Id: default May 25 16:27:29.608043 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Name: Default May 25 16:27:29.608043 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Id: 3e8c39550e4e41e79cc56aa7d22ae052 May 25 16:27:29.608043 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Name: tempest-AttachVolumeTestJSON-1756534258 May 25 16:27:29.608043 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Role: reader,member May 25 16:27:29.608043 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Roles: reader,member May 25 16:27:29.609374 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e8c39550e4e41e79cc56aa7d22ae052"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3e8c39550e4e41e79cc56aa7d22ae052"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3e8c39550e4e41e79cc56aa7d22ae052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e8c39550e4e41e79cc56aa7d22ae052"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:27:29.609374 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant: tempest-AttachVolumeTestJSON-1756534258 May 25 16:27:29.609374 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Id: 3e8c39550e4e41e79cc56aa7d22ae052 May 25 16:27:29.609374 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1756534258 May 25 16:27:29.609374 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User: tempest-AttachVolumeTestJSON-1756534258-project May 25 16:27:29.609374 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Id: default May 25 16:27:29.609374 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Name: Default May 25 16:27:29.609374 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Id: 15fae427f22d476fa0e378949de41292 May 25 16:27:29.609374 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Name: tempest-AttachVolumeTestJSON-1756534258-project May 25 16:27:29.609374 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: method: > May 25 16:27:29.609374 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: exception: Instance 9c525fad-3e59-4bcd-9263-cf3a13d13e3f could not be found. May 25 16:27:29.609374 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: action_args: {'id': '9c525fad-3e59-4bcd-9263-cf3a13d13e3f'} May 25 16:27:29.610160 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:27:29.610160 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:29.610160 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:27:29.610160 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:27:29.610160 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:27:29.610160 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:27:29.610160 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:27:29.610160 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:27:29.610160 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:27:29.610160 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:27:29.610160 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c525fad-3e59-4bcd-9263-cf3a13d13e3f could not be found. May 25 16:27:29.610160 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:29.610160 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:29.610160 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:29.610160 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:29.610160 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:29.610160 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:29.610160 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:27:29.610160 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:27:29.610160 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:27:29.611343 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:27:29.611343 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:27:29.611343 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:27:29.611343 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:27:29.611343 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:27:29.611343 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:27:29.611343 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:27:29.611343 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c525fad-3e59-4bcd-9263-cf3a13d13e3f could not be found. May 25 16:27:29.611343 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:29.611343 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:29.611343 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:29.611343 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:29.611343 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:29.611343 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:29.611343 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:27:29.611343 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:27:29.611343 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c525fad-3e59-4bcd-9263-cf3a13d13e3f could not be found. May 25 16:27:29.611343 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:29.612390 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-4512739c-4cda-44c2-a129-47a78ef89289 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] Returning 404 to user: Instance 9c525fad-3e59-4bcd-9263-cf3a13d13e3f could not be found. {{(pid=117510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:27:29.612390 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-4512739c-4cda-44c2-a129-47a78ef89289 tempest-AttachVolumeTestJSON-1756534258 tempest-AttachVolumeTestJSON-1756534258-project] 10.222.0.42 "GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f" status: 404 len: 111 microversion: 2.1 time: 0.030927 May 25 16:27:29.613397 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 399/804] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:27:29 2022] GET /compute/v2.1/servers/9c525fad-3e59-4bcd-9263-cf3a13d13e3f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:27:33.693238 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-f4b916fc-5b5f-41f8-b41d-db20daf836fc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:33.699873 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-f4b916fc-5b5f-41f8-b41d-db20daf836fc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:33.707949 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f4b916fc-5b5f-41f8-b41d-db20daf836fc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:33.708399 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f4b916fc-5b5f-41f8-b41d-db20daf836fc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:33.709168 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f4b916fc-5b5f-41f8-b41d-db20daf836fc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:33.709583 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f4b916fc-5b5f-41f8-b41d-db20daf836fc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:33.748315 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-f4b916fc-5b5f-41f8-b41d-db20daf836fc tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.063048 May 25 16:27:33.753628 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 406/805] 10.222.0.42 () {60 vars in 1342 bytes} [Wed May 25 16:27:33 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:27:33.819393 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-4b001c1c-5cc7-462f-bdcf-eee7628ed6b2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:33.820075 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-4b001c1c-5cc7-462f-bdcf-eee7628ed6b2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:33.827532 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4b001c1c-5cc7-462f-bdcf-eee7628ed6b2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:33.827983 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4b001c1c-5cc7-462f-bdcf-eee7628ed6b2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:33.828749 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4b001c1c-5cc7-462f-bdcf-eee7628ed6b2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:33.829184 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4b001c1c-5cc7-462f-bdcf-eee7628ed6b2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:33.859535 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-4b001c1c-5cc7-462f-bdcf-eee7628ed6b2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Going to try to terminate instance {{(pid=117510) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:27:33.941657 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-4b001c1c-5cc7-462f-bdcf-eee7628ed6b2 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 204 len: 0 microversion: 2.20 time: 0.127668 May 25 16:27:33.943230 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 400/806] 10.222.0.42 () {60 vars in 1279 bytes} [Wed May 25 16:27:33 2022] DELETE /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 25 16:27:33.952097 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-f09cf849-a3c7-4c0f-b10e-5693262e7025 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:33.952913 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-f09cf849-a3c7-4c0f-b10e-5693262e7025 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:33.960660 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f09cf849-a3c7-4c0f-b10e-5693262e7025 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:33.961288 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f09cf849-a3c7-4c0f-b10e-5693262e7025 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:33.962483 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f09cf849-a3c7-4c0f-b10e-5693262e7025 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:33.963118 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f09cf849-a3c7-4c0f-b10e-5693262e7025 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:34.142784 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-f09cf849-a3c7-4c0f-b10e-5693262e7025 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:27:34.155856 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-f09cf849-a3c7-4c0f-b10e-5693262e7025 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:27:34.158159 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-f09cf849-a3c7-4c0f-b10e-5693262e7025 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:27:34.160991 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-f09cf849-a3c7-4c0f-b10e-5693262e7025 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1724 microversion: 2.20 time: 0.213525 May 25 16:27:34.163478 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 407/807] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:27:33 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:27:35.181644 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-e05bd2dc-8334-48f0-b8f5-4a8707287475 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:35.183522 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-e05bd2dc-8334-48f0-b8f5-4a8707287475 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:35.189896 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e05bd2dc-8334-48f0-b8f5-4a8707287475 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:35.190348 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e05bd2dc-8334-48f0-b8f5-4a8707287475 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:35.191121 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e05bd2dc-8334-48f0-b8f5-4a8707287475 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:35.191557 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e05bd2dc-8334-48f0-b8f5-4a8707287475 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:35.335791 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-e05bd2dc-8334-48f0-b8f5-4a8707287475 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:27:35.344557 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-e05bd2dc-8334-48f0-b8f5-4a8707287475 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:27:35.346069 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-e05bd2dc-8334-48f0-b8f5-4a8707287475 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:27:35.347213 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-e05bd2dc-8334-48f0-b8f5-4a8707287475 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1724 microversion: 2.20 time: 0.170652 May 25 16:27:35.347756 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 401/808] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:27:35 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:27:36.072085 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-4b278114-f252-4dfb-b40f-ef89b24766dc tempest-VolumesTestJSON-89460392 tempest-VolumesTestJSON-89460392-project] Calling method '.version_select at 0x7f51ee1651f0>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:36.126724 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-4b278114-f252-4dfb-b40f-ef89b24766dc tempest-VolumesTestJSON-89460392 tempest-VolumesTestJSON-89460392-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/535fc43d-62cf-4dab-a5fc-29e2fe167705" status: 200 len: 350 microversion: 2.1 time: 0.058960 May 25 16:27:36.132751 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 408/809] 10.222.0.42 () {58 vars in 1244 bytes} [Wed May 25 16:27:36 2022] GET /compute/v2.1/os-volumes/535fc43d-62cf-4dab-a5fc-29e2fe167705 => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:27:36.318924 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-1a268d83-61c7-4f0a-835e-49dc1b2da997 req-72f77859-c3ea-451c-b4e8-62f97012992b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7652df85-9116-41c0-b1a1-32a070414bd8", "name": "network-vif-deleted", "tag": "3be8d920-dc13-499f-b9d6-d875dbb50bdc"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:27:36.336755 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-1a268d83-61c7-4f0a-835e-49dc1b2da997 req-72f77859-c3ea-451c-b4e8-62f97012992b service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:36.337925 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-1a268d83-61c7-4f0a-835e-49dc1b2da997 req-72f77859-c3ea-451c-b4e8-62f97012992b service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:36.361625 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-1a268d83-61c7-4f0a-835e-49dc1b2da997 req-72f77859-c3ea-451c-b4e8-62f97012992b service nova] Creating event network-vif-deleted:3be8d920-dc13-499f-b9d6-d875dbb50bdc for instance 7652df85-9116-41c0-b1a1-32a070414bd8 on hv-cinder-84327 May 25 16:27:36.369642 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-410470b8-8b60-4376-87ac-6fd81431139b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:36.376093 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-410470b8-8b60-4376-87ac-6fd81431139b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:36.389172 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-1a268d83-61c7-4f0a-835e-49dc1b2da997 req-72f77859-c3ea-451c-b4e8-62f97012992b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075159 May 25 16:27:36.390665 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-410470b8-8b60-4376-87ac-6fd81431139b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:36.391373 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-410470b8-8b60-4376-87ac-6fd81431139b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:36.392301 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 402/810] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:27:36.393422 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-410470b8-8b60-4376-87ac-6fd81431139b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:36.394229 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-410470b8-8b60-4376-87ac-6fd81431139b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:36.560775 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-410470b8-8b60-4376-87ac-6fd81431139b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:27:36.576265 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-410470b8-8b60-4376-87ac-6fd81431139b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:27:36.578621 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-410470b8-8b60-4376-87ac-6fd81431139b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9178e89a790d48d19b25c4c22bd0ca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916473814d44ac1ae6339f0d052daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:27:36.579829 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-410470b8-8b60-4376-87ac-6fd81431139b tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 200 len: 1366 microversion: 2.20 time: 0.216199 May 25 16:27:36.584354 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 409/811] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:27:36 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:27:37.603037 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-ad01c6d0-fb6a-4258-ae48-f4f07d4d28bd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:37.603881 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-ad01c6d0-fb6a-4258-ae48-f4f07d4d28bd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:37.607381 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-67f8b1f1-b3f6-40a7-b833-96b66d590b80 tempest-VolumesTestJSON-89460392 tempest-VolumesTestJSON-89460392-project] Calling method '.version_select at 0x7f51f3350af0>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:37.610655 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ad01c6d0-fb6a-4258-ae48-f4f07d4d28bd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:37.611103 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ad01c6d0-fb6a-4258-ae48-f4f07d4d28bd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:37.611871 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ad01c6d0-fb6a-4258-ae48-f4f07d4d28bd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:37.612309 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ad01c6d0-fb6a-4258-ae48-f4f07d4d28bd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:37.626694 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.wsgi [None req-ad01c6d0-fb6a-4258-ae48-f4f07d4d28bd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] HTTP exception thrown: Instance 7652df85-9116-41c0-b1a1-32a070414bd8 could not be found. May 25 16:27:37.628335 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-ad01c6d0-fb6a-4258-ae48-f4f07d4d28bd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Request method failure captured: May 25 16:27:37.628335 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: request: GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 HTTP/1.1 May 25 16:27:37.628335 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept: application/json May 25 16:27:37.628335 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept-Encoding: identity May 25 16:27:37.628335 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Connection: close May 25 16:27:37.628335 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Length: 0 May 25 16:27:37.628335 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Type: application/json May 25 16:27:37.628335 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Host: 10.222.0.42 May 25 16:27:37.628335 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Openstack-System-Scope: None May 25 16:27:37.628335 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: User-Agent: python-urllib3/1.26.9 May 25 16:27:37.628335 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Auth-Token: gAAAAABijldbuv6RCYGKoWwJhN6lRmiU70u8cExXqiSTujenf4slPFEDO2l80YAOnHkbj2OhZY3H4OpUSOAxkbmdwCFbXSYUM1V7OOl5sy1rYoEnzomPg28PrGegcvWSA5ApSGv5egQo_Ac61surIon3gcAZJlCzkLOUqq0u1u2qejLAHQh9k3w May 25 16:27:37.628335 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Id: None May 25 16:27:37.628335 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Name: None May 25 16:27:37.628335 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Identity-Status: Confirmed May 25 16:27:37.628335 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Is-Admin-Project: True May 25 16:27:37.628335 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Openstack-Nova-Api-Version: 2.20 May 25 16:27:37.628335 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Id: default May 25 16:27:37.628335 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Name: Default May 25 16:27:37.628335 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Id: e916473814d44ac1ae6339f0d052daa1 May 25 16:27:37.628335 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1285056380 May 25 16:27:37.628335 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Role: reader,member May 25 16:27:37.628335 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Roles: reader,member May 25 16:27:37.630012 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e916473814d44ac1ae6339f0d052daa1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e916473814d44ac1ae6339f0d052daa1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e916473814d44ac1ae6339f0d052daa1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e916473814d44ac1ae6339f0d052daa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:27:37.630012 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1285056380 May 25 16:27:37.630012 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Id: e916473814d44ac1ae6339f0d052daa1 May 25 16:27:37.630012 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1285056380 May 25 16:27:37.630012 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User: tempest-AttachVolumeShelveTestJSON-1285056380-project May 25 16:27:37.630012 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Id: default May 25 16:27:37.630012 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Name: Default May 25 16:27:37.630012 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Id: 9178e89a790d48d19b25c4c22bd0ca4e May 25 16:27:37.630012 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1285056380-project May 25 16:27:37.630012 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: method: > May 25 16:27:37.630012 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: exception: Instance 7652df85-9116-41c0-b1a1-32a070414bd8 could not be found. May 25 16:27:37.630012 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: action_args: {'id': '7652df85-9116-41c0-b1a1-32a070414bd8'} May 25 16:27:37.630945 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:27:37.630945 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:37.630945 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:27:37.630945 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:27:37.630945 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:27:37.630945 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:27:37.630945 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:27:37.630945 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:27:37.630945 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:27:37.630945 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:27:37.630945 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7652df85-9116-41c0-b1a1-32a070414bd8 could not be found. May 25 16:27:37.630945 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:37.630945 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:37.630945 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:37.630945 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:37.630945 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:37.630945 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:37.630945 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:27:37.630945 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:27:37.630945 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:27:37.632474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:27:37.632474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:27:37.632474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:27:37.632474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:27:37.632474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:27:37.632474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:27:37.632474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:27:37.632474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7652df85-9116-41c0-b1a1-32a070414bd8 could not be found. May 25 16:27:37.632474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:37.632474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:37.632474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:37.632474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:37.632474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:37.632474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:37.632474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:27:37.632474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:27:37.632474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7652df85-9116-41c0-b1a1-32a070414bd8 could not be found. May 25 16:27:37.632474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:37.634013 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-ad01c6d0-fb6a-4258-ae48-f4f07d4d28bd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Returning 404 to user: Instance 7652df85-9116-41c0-b1a1-32a070414bd8 could not be found. {{(pid=117510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:27:37.634013 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-ad01c6d0-fb6a-4258-ae48-f4f07d4d28bd tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 404 len: 111 microversion: 2.20 time: 0.030992 May 25 16:27:37.634013 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 403/812] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:27:37 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 16:27:37.638966 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-9ac65f0e-5917-4e55-b6fc-349ebea19de6 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '.version_select at 0x7f51ed883940>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:37.657643 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-9ac65f0e-5917-4e55-b6fc-349ebea19de6 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2042314323" status: 204 len: 0 microversion: 2.20 time: 0.022860 May 25 16:27:37.662205 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-67f8b1f1-b3f6-40a7-b833-96b66d590b80 tempest-VolumesTestJSON-89460392 tempest-VolumesTestJSON-89460392-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/771d14a1-bc4f-4aa4-850b-59e2549eb895" status: 200 len: 351 microversion: 2.1 time: 0.058511 May 25 16:27:37.662882 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 410/813] 10.222.0.42 () {58 vars in 1244 bytes} [Wed May 25 16:27:37 2022] GET /compute/v2.1/os-volumes/771d14a1-bc4f-4aa4-850b-59e2549eb895 => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:27:37.663382 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 404/814] 10.222.0.42 () {60 vars in 1261 bytes} [Wed May 25 16:27:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2042314323 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 25 16:27:38.999536 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-1fae900f-3d8f-4e01-92ff-c9d8fc66b5b7 tempest-VolumesTestJSON-89460392 tempest-VolumesTestJSON-89460392-project] Calling method '.version_select at 0x7f51f3354160>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:39.046845 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-1fae900f-3d8f-4e01-92ff-c9d8fc66b5b7 tempest-VolumesTestJSON-89460392 tempest-VolumesTestJSON-89460392-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/9c421cc9-756c-4e6c-93ad-b76af1c8d76d" status: 200 len: 351 microversion: 2.1 time: 0.051736 May 25 16:27:39.047351 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 411/815] 10.222.0.42 () {58 vars in 1244 bytes} [Wed May 25 16:27:38 2022] GET /compute/v2.1/os-volumes/9c421cc9-756c-4e6c-93ad-b76af1c8d76d => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:27:39.058959 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-ab70e31d-61c3-4c12-93ad-7e857274a962 tempest-VolumesTestJSON-89460392 tempest-VolumesTestJSON-89460392-project] Calling method '.version_select at 0x7f51ed96ae50>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:39.140064 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-ab70e31d-61c3-4c12-93ad-7e857274a962 tempest-VolumesTestJSON-89460392 tempest-VolumesTestJSON-89460392-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085515 May 25 16:27:39.140755 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 405/816] 10.222.0.42 () {58 vars in 1133 bytes} [Wed May 25 16:27:39 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:27:39.154912 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-3c6c581c-48ec-40fa-82c1-a33920ee0ef5 tempest-VolumesTestJSON-89460392 tempest-VolumesTestJSON-89460392-project] Calling method '.version_select at 0x7f51ee0c9b80>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:39.235331 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-3c6c581c-48ec-40fa-82c1-a33920ee0ef5 tempest-VolumesTestJSON-89460392 tempest-VolumesTestJSON-89460392-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.084841 May 25 16:27:39.235909 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 412/817] 10.222.0.42 () {58 vars in 1148 bytes} [Wed May 25 16:27:39 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:27:39.247826 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-03309e68-90e4-478a-a5c0-f1acd8df247a tempest-VolumesTestJSON-89460392 tempest-VolumesTestJSON-89460392-project] Calling method '.version_select at 0x7f51ed8e71f0>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:39.330895 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-03309e68-90e4-478a-a5c0-f1acd8df247a tempest-VolumesTestJSON-89460392 tempest-VolumesTestJSON-89460392-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087123 May 25 16:27:39.331462 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 406/818] 10.222.0.42 () {58 vars in 1133 bytes} [Wed May 25 16:27:39 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:27:39.343531 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-99606f25-7fb5-4c35-a311-ad6dd78e2938 tempest-VolumesTestJSON-89460392 tempest-VolumesTestJSON-89460392-project] Calling method '.version_select at 0x7f51f33543a0>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:39.434823 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-99606f25-7fb5-4c35-a311-ad6dd78e2938 tempest-VolumesTestJSON-89460392 tempest-VolumesTestJSON-89460392-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.092251 May 25 16:27:39.434823 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 413/819] 10.222.0.42 () {58 vars in 1166 bytes} [Wed May 25 16:27:39 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:27:39.444057 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-ecba7c54-f779-46a0-bb34-c111adac819a tempest-VolumesTestJSON-89460392 tempest-VolumesTestJSON-89460392-project] Calling method '.version_select at 0x7f51ed8ffc10>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:39.526040 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-ecba7c54-f779-46a0-bb34-c111adac819a tempest-VolumesTestJSON-89460392 tempest-VolumesTestJSON-89460392-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085746 May 25 16:27:39.526622 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 407/820] 10.222.0.42 () {58 vars in 1169 bytes} [Wed May 25 16:27:39 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:27:39.539447 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-a7687f59-d349-410e-8710-38b124ceddac tempest-VolumesTestJSON-89460392 tempest-VolumesTestJSON-89460392-project] Calling method '.version_select at 0x7f51ee1c4550>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:39.639496 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-a7687f59-d349-410e-8710-38b124ceddac tempest-VolumesTestJSON-89460392 tempest-VolumesTestJSON-89460392-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.104171 May 25 16:27:39.640169 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 414/821] 10.222.0.42 () {58 vars in 1154 bytes} [Wed May 25 16:27:39 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:27:39.650955 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-ab0c183e-300e-41d6-b4c8-ddbf12d8e26e tempest-VolumesTestJSON-89460392 tempest-VolumesTestJSON-89460392-project] Calling method '.version_select at 0x7f51ed883c10>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:39.674830 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-9a4b0b39-cf9e-46b8-956d-719805f02320 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:39.675470 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-9a4b0b39-cf9e-46b8-956d-719805f02320 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:39.677700 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:27:39.685112 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9a4b0b39-cf9e-46b8-956d-719805f02320 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:39.685621 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9a4b0b39-cf9e-46b8-956d-719805f02320 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:39.686782 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9a4b0b39-cf9e-46b8-956d-719805f02320 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:39.687190 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9a4b0b39-cf9e-46b8-956d-719805f02320 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:39.703993 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.wsgi [None req-9a4b0b39-cf9e-46b8-956d-719805f02320 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] HTTP exception thrown: Instance 7652df85-9116-41c0-b1a1-32a070414bd8 could not be found. May 25 16:27:39.705666 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-9a4b0b39-cf9e-46b8-956d-719805f02320 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Request method failure captured: May 25 16:27:39.705666 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: DELETE /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 HTTP/1.1 May 25 16:27:39.705666 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:27:39.705666 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:27:39.705666 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:27:39.705666 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 0 May 25 16:27:39.705666 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:27:39.705666 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:27:39.705666 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:27:39.705666 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:27:39.705666 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijldbuv6RCYGKoWwJhN6lRmiU70u8cExXqiSTujenf4slPFEDO2l80YAOnHkbj2OhZY3H4OpUSOAxkbmdwCFbXSYUM1V7OOl5sy1rYoEnzomPg28PrGegcvWSA5ApSGv5egQo_Ac61surIon3gcAZJlCzkLOUqq0u1u2qejLAHQh9k3w May 25 16:27:39.705666 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:27:39.705666 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:27:39.705666 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:27:39.705666 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:27:39.705666 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Openstack-Nova-Api-Version: 2.20 May 25 16:27:39.705666 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:27:39.705666 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:27:39.705666 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: e916473814d44ac1ae6339f0d052daa1 May 25 16:27:39.705666 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1285056380 May 25 16:27:39.705666 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:27:39.705666 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:27:39.707345 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e916473814d44ac1ae6339f0d052daa1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e916473814d44ac1ae6339f0d052daa1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e916473814d44ac1ae6339f0d052daa1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e916473814d44ac1ae6339f0d052daa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:27:39.707345 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1285056380 May 25 16:27:39.707345 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: e916473814d44ac1ae6339f0d052daa1 May 25 16:27:39.707345 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1285056380 May 25 16:27:39.707345 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-AttachVolumeShelveTestJSON-1285056380-project May 25 16:27:39.707345 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:27:39.707345 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:27:39.707345 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: 9178e89a790d48d19b25c4c22bd0ca4e May 25 16:27:39.707345 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1285056380-project May 25 16:27:39.707345 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: > May 25 16:27:39.707345 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Instance 7652df85-9116-41c0-b1a1-32a070414bd8 could not be found. May 25 16:27:39.707345 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'id': '7652df85-9116-41c0-b1a1-32a070414bd8'} May 25 16:27:39.708246 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:27:39.708246 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:39.708246 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:27:39.708246 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:27:39.708246 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:27:39.708246 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:27:39.708246 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:27:39.708246 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:27:39.708246 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:27:39.708246 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:27:39.708246 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7652df85-9116-41c0-b1a1-32a070414bd8 could not be found. May 25 16:27:39.708246 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:39.708246 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:39.708246 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:39.708246 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:39.708246 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:39.708246 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:39.708246 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:27:39.708246 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:27:39.708246 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:27:39.709687 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:27:39.709687 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 16:27:39.709687 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 16:27:39.709687 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 16:27:39.709687 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 16:27:39.709687 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:27:39.709687 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:27:39.709687 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:27:39.709687 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:27:39.709687 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7652df85-9116-41c0-b1a1-32a070414bd8 could not be found. May 25 16:27:39.709687 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:39.709687 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:39.709687 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:39.709687 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:39.709687 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:39.709687 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:39.709687 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:27:39.709687 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:27:39.709687 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7652df85-9116-41c0-b1a1-32a070414bd8 could not be found. May 25 16:27:39.709687 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:39.711079 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-9a4b0b39-cf9e-46b8-956d-719805f02320 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Returning 404 to user: Instance 7652df85-9116-41c0-b1a1-32a070414bd8 could not be found. {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:27:39.711079 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-9a4b0b39-cf9e-46b8-956d-719805f02320 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 404 len: 111 microversion: 2.20 time: 0.037825 May 25 16:27:39.711079 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 415/822] 10.222.0.42 () {60 vars in 1279 bytes} [Wed May 25 16:27:39 2022] DELETE /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 25 16:27:39.718585 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-fab9140d-0083-470f-896c-3e1036224b06 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:39.719277 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-fab9140d-0083-470f-896c-3e1036224b06 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: 7652df85-9116-41c0-b1a1-32a070414bd8] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:39.725658 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fab9140d-0083-470f-896c-3e1036224b06 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:39.726123 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fab9140d-0083-470f-896c-3e1036224b06 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:39.726882 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fab9140d-0083-470f-896c-3e1036224b06 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:39.727308 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fab9140d-0083-470f-896c-3e1036224b06 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:39.733787 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-ab0c183e-300e-41d6-b4c8-ddbf12d8e26e tempest-VolumesTestJSON-89460392 tempest-VolumesTestJSON-89460392-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086617 May 25 16:27:39.734355 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 408/823] 10.222.0.42 () {58 vars in 1187 bytes} [Wed May 25 16:27:39 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:27:39.741752 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.wsgi [None req-fab9140d-0083-470f-896c-3e1036224b06 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] HTTP exception thrown: Instance 7652df85-9116-41c0-b1a1-32a070414bd8 could not be found. May 25 16:27:39.743285 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-fab9140d-0083-470f-896c-3e1036224b06 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Request method failure captured: May 25 16:27:39.743285 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 HTTP/1.1 May 25 16:27:39.743285 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:27:39.743285 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:27:39.743285 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:27:39.743285 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 0 May 25 16:27:39.743285 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:27:39.743285 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:27:39.743285 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:27:39.743285 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:27:39.743285 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijldbuv6RCYGKoWwJhN6lRmiU70u8cExXqiSTujenf4slPFEDO2l80YAOnHkbj2OhZY3H4OpUSOAxkbmdwCFbXSYUM1V7OOl5sy1rYoEnzomPg28PrGegcvWSA5ApSGv5egQo_Ac61surIon3gcAZJlCzkLOUqq0u1u2qejLAHQh9k3w May 25 16:27:39.743285 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:27:39.743285 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:27:39.743285 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:27:39.743285 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:27:39.743285 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Openstack-Nova-Api-Version: 2.20 May 25 16:27:39.743285 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:27:39.743285 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:27:39.743285 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: e916473814d44ac1ae6339f0d052daa1 May 25 16:27:39.743285 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1285056380 May 25 16:27:39.743285 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:27:39.743285 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:27:39.744909 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e916473814d44ac1ae6339f0d052daa1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e916473814d44ac1ae6339f0d052daa1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e916473814d44ac1ae6339f0d052daa1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e916473814d44ac1ae6339f0d052daa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:27:39.744909 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1285056380 May 25 16:27:39.744909 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: e916473814d44ac1ae6339f0d052daa1 May 25 16:27:39.744909 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1285056380 May 25 16:27:39.744909 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-AttachVolumeShelveTestJSON-1285056380-project May 25 16:27:39.744909 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:27:39.744909 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:27:39.744909 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: 9178e89a790d48d19b25c4c22bd0ca4e May 25 16:27:39.744909 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1285056380-project May 25 16:27:39.744909 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: > May 25 16:27:39.744909 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Instance 7652df85-9116-41c0-b1a1-32a070414bd8 could not be found. May 25 16:27:39.744909 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'id': '7652df85-9116-41c0-b1a1-32a070414bd8'} May 25 16:27:39.746374 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:27:39.746374 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:39.746374 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:27:39.746374 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:27:39.746374 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:27:39.746374 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:27:39.746374 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:27:39.746374 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:27:39.746374 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:27:39.746374 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:27:39.746374 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7652df85-9116-41c0-b1a1-32a070414bd8 could not be found. May 25 16:27:39.746374 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:39.746374 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:39.746374 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:39.746374 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:39.746374 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:39.746374 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:39.746374 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:27:39.746374 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:27:39.746374 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:27:39.748114 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:27:39.748114 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:27:39.748114 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:27:39.748114 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:27:39.748114 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:27:39.748114 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:27:39.748114 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:27:39.748114 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7652df85-9116-41c0-b1a1-32a070414bd8 could not be found. May 25 16:27:39.748114 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:39.748114 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:39.748114 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:39.748114 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:39.748114 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:39.748114 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:39.748114 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:27:39.748114 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:27:39.748114 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7652df85-9116-41c0-b1a1-32a070414bd8 could not be found. May 25 16:27:39.748114 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:39.749457 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-fab9140d-0083-470f-896c-3e1036224b06 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Returning 404 to user: Instance 7652df85-9116-41c0-b1a1-32a070414bd8 could not be found. {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:27:39.749457 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-fab9140d-0083-470f-896c-3e1036224b06 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8" status: 404 len: 111 microversion: 2.20 time: 0.030155 May 25 16:27:39.749457 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 416/824] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:27:39 2022] GET /compute/v2.1/servers/7652df85-9116-41c0-b1a1-32a070414bd8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 25 16:27:39.750484 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-9973d59d-554b-4625-b21f-90863ae2f8b2 tempest-VolumesTestJSON-89460392 tempest-VolumesTestJSON-89460392-project] Calling method '.version_select at 0x7f51f32b1dc0>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:39.838222 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-9973d59d-554b-4625-b21f-90863ae2f8b2 tempest-VolumesTestJSON-89460392 tempest-VolumesTestJSON-89460392-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.095867 May 25 16:27:39.839023 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 409/825] 10.222.0.42 () {58 vars in 1154 bytes} [Wed May 25 16:27:39 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:27:40.888880 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-9fd0ba4e-4927-4a48-ad5a-a2804661c793 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:40.890005 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-9fd0ba4e-4927-4a48-ad5a-a2804661c793 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:40.896357 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9fd0ba4e-4927-4a48-ad5a-a2804661c793 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:40.896804 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9fd0ba4e-4927-4a48-ad5a-a2804661c793 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:40.897569 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9fd0ba4e-4927-4a48-ad5a-a2804661c793 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:40.898043 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9fd0ba4e-4927-4a48-ad5a-a2804661c793 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:40.912600 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.wsgi [None req-9fd0ba4e-4927-4a48-ad5a-a2804661c793 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] HTTP exception thrown: Instance d3da72ce-f083-455e-ae40-9530c53126ef could not be found. May 25 16:27:40.914180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-9fd0ba4e-4927-4a48-ad5a-a2804661c793 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Request method failure captured: May 25 16:27:40.914180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: DELETE /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef HTTP/1.1 May 25 16:27:40.914180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:27:40.914180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:27:40.914180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:27:40.914180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 0 May 25 16:27:40.914180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:27:40.914180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:27:40.914180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:27:40.914180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:27:40.914180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijldbuv6RCYGKoWwJhN6lRmiU70u8cExXqiSTujenf4slPFEDO2l80YAOnHkbj2OhZY3H4OpUSOAxkbmdwCFbXSYUM1V7OOl5sy1rYoEnzomPg28PrGegcvWSA5ApSGv5egQo_Ac61surIon3gcAZJlCzkLOUqq0u1u2qejLAHQh9k3w May 25 16:27:40.914180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:27:40.914180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:27:40.914180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:27:40.914180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:27:40.914180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Openstack-Nova-Api-Version: 2.20 May 25 16:27:40.914180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:27:40.914180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:27:40.914180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: e916473814d44ac1ae6339f0d052daa1 May 25 16:27:40.914180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1285056380 May 25 16:27:40.914180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:27:40.914180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:27:40.916049 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e916473814d44ac1ae6339f0d052daa1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e916473814d44ac1ae6339f0d052daa1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e916473814d44ac1ae6339f0d052daa1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e916473814d44ac1ae6339f0d052daa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:27:40.916049 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1285056380 May 25 16:27:40.916049 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: e916473814d44ac1ae6339f0d052daa1 May 25 16:27:40.916049 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1285056380 May 25 16:27:40.916049 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-AttachVolumeShelveTestJSON-1285056380-project May 25 16:27:40.916049 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:27:40.916049 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:27:40.916049 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: 9178e89a790d48d19b25c4c22bd0ca4e May 25 16:27:40.916049 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1285056380-project May 25 16:27:40.916049 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: > May 25 16:27:40.916049 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Instance d3da72ce-f083-455e-ae40-9530c53126ef could not be found. May 25 16:27:40.916049 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'id': 'd3da72ce-f083-455e-ae40-9530c53126ef'} May 25 16:27:40.916912 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:27:40.916912 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:40.916912 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:27:40.916912 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:27:40.916912 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:27:40.916912 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:27:40.916912 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:27:40.916912 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:27:40.916912 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:27:40.916912 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:27:40.916912 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3da72ce-f083-455e-ae40-9530c53126ef could not be found. May 25 16:27:40.916912 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:40.916912 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:40.916912 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:40.916912 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:40.916912 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:40.916912 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:40.916912 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:27:40.916912 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:27:40.916912 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:27:40.918566 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:27:40.918566 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 16:27:40.918566 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 16:27:40.918566 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 16:27:40.918566 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 16:27:40.918566 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:27:40.918566 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:27:40.918566 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:27:40.918566 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:27:40.918566 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3da72ce-f083-455e-ae40-9530c53126ef could not be found. May 25 16:27:40.918566 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:40.918566 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:40.918566 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:40.918566 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:40.918566 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:40.918566 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:40.918566 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:27:40.918566 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:27:40.918566 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3da72ce-f083-455e-ae40-9530c53126ef could not be found. May 25 16:27:40.918566 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:40.921098 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-9fd0ba4e-4927-4a48-ad5a-a2804661c793 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Returning 404 to user: Instance d3da72ce-f083-455e-ae40-9530c53126ef could not be found. {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:27:40.921098 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-9fd0ba4e-4927-4a48-ad5a-a2804661c793 tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 404 len: 111 microversion: 2.20 time: 0.031315 May 25 16:27:40.921098 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 417/826] 10.222.0.42 () {60 vars in 1279 bytes} [Wed May 25 16:27:40 2022] DELETE /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 16:27:40.924967 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-006291fd-188f-4793-8f40-cab9348334fe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:40.925633 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-006291fd-188f-4793-8f40-cab9348334fe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] [instance: d3da72ce-f083-455e-ae40-9530c53126ef] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:40.931603 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-006291fd-188f-4793-8f40-cab9348334fe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:40.932051 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-006291fd-188f-4793-8f40-cab9348334fe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:40.933599 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-006291fd-188f-4793-8f40-cab9348334fe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:40.934155 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-006291fd-188f-4793-8f40-cab9348334fe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:40.947604 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.wsgi [None req-006291fd-188f-4793-8f40-cab9348334fe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] HTTP exception thrown: Instance d3da72ce-f083-455e-ae40-9530c53126ef could not be found. May 25 16:27:40.949932 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-006291fd-188f-4793-8f40-cab9348334fe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Request method failure captured: May 25 16:27:40.949932 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: request: GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef HTTP/1.1 May 25 16:27:40.949932 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept: application/json May 25 16:27:40.949932 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept-Encoding: identity May 25 16:27:40.949932 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Connection: close May 25 16:27:40.949932 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Length: 0 May 25 16:27:40.949932 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Type: application/json May 25 16:27:40.949932 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Host: 10.222.0.42 May 25 16:27:40.949932 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Openstack-System-Scope: None May 25 16:27:40.949932 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: User-Agent: python-urllib3/1.26.9 May 25 16:27:40.949932 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Auth-Token: gAAAAABijldbuv6RCYGKoWwJhN6lRmiU70u8cExXqiSTujenf4slPFEDO2l80YAOnHkbj2OhZY3H4OpUSOAxkbmdwCFbXSYUM1V7OOl5sy1rYoEnzomPg28PrGegcvWSA5ApSGv5egQo_Ac61surIon3gcAZJlCzkLOUqq0u1u2qejLAHQh9k3w May 25 16:27:40.949932 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Id: None May 25 16:27:40.949932 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Name: None May 25 16:27:40.949932 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Identity-Status: Confirmed May 25 16:27:40.949932 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Is-Admin-Project: True May 25 16:27:40.949932 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Openstack-Nova-Api-Version: 2.20 May 25 16:27:40.949932 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Id: default May 25 16:27:40.949932 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Name: Default May 25 16:27:40.949932 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Id: e916473814d44ac1ae6339f0d052daa1 May 25 16:27:40.949932 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1285056380 May 25 16:27:40.949932 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Role: reader,member May 25 16:27:40.949932 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Roles: reader,member May 25 16:27:40.951509 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e916473814d44ac1ae6339f0d052daa1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e916473814d44ac1ae6339f0d052daa1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e916473814d44ac1ae6339f0d052daa1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e916473814d44ac1ae6339f0d052daa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:27:40.951509 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1285056380 May 25 16:27:40.951509 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Id: e916473814d44ac1ae6339f0d052daa1 May 25 16:27:40.951509 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1285056380 May 25 16:27:40.951509 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User: tempest-AttachVolumeShelveTestJSON-1285056380-project May 25 16:27:40.951509 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Id: default May 25 16:27:40.951509 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Name: Default May 25 16:27:40.951509 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Id: 9178e89a790d48d19b25c4c22bd0ca4e May 25 16:27:40.951509 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1285056380-project May 25 16:27:40.951509 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: method: > May 25 16:27:40.951509 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: exception: Instance d3da72ce-f083-455e-ae40-9530c53126ef could not be found. May 25 16:27:40.951509 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: action_args: {'id': 'd3da72ce-f083-455e-ae40-9530c53126ef'} May 25 16:27:40.952466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:27:40.952466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:40.952466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:27:40.952466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:27:40.952466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:27:40.952466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:27:40.952466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:27:40.952466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:27:40.952466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:27:40.952466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:27:40.952466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3da72ce-f083-455e-ae40-9530c53126ef could not be found. May 25 16:27:40.952466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:40.952466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:40.952466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:40.952466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:40.952466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:40.952466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:40.952466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:27:40.952466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:27:40.952466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:27:40.953959 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:27:40.953959 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:27:40.953959 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:27:40.953959 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:27:40.953959 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:27:40.953959 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:27:40.953959 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:27:40.953959 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3da72ce-f083-455e-ae40-9530c53126ef could not be found. May 25 16:27:40.953959 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:40.953959 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:40.953959 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:40.953959 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:40.953959 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:40.953959 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:40.953959 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:27:40.953959 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:27:40.953959 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3da72ce-f083-455e-ae40-9530c53126ef could not be found. May 25 16:27:40.953959 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:40.955268 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-006291fd-188f-4793-8f40-cab9348334fe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] Returning 404 to user: Instance d3da72ce-f083-455e-ae40-9530c53126ef could not be found. {{(pid=117510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:27:40.955268 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-006291fd-188f-4793-8f40-cab9348334fe tempest-AttachVolumeShelveTestJSON-1285056380 tempest-AttachVolumeShelveTestJSON-1285056380-project] 10.222.0.42 "GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef" status: 404 len: 111 microversion: 2.20 time: 0.030749 May 25 16:27:40.955268 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 410/827] 10.222.0.42 () {60 vars in 1276 bytes} [Wed May 25 16:27:40 2022] GET /compute/v2.1/servers/d3da72ce-f083-455e-ae40-9530c53126ef => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 16:27:45.917928 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-160d9bb9-43e2-4422-87d6-bd796856fe5f tempest-VolumesNegativeTest-189726527 tempest-VolumesNegativeTest-189726527-project] Action: 'create', calling method: .version_select at 0x7f51f33509d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1743499841", "metadata": {"Type": "work"}}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:27:45.924574 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-160d9bb9-43e2-4422-87d6-bd796856fe5f tempest-VolumesNegativeTest-189726527 tempest-VolumesNegativeTest-189726527-project] Request method failure captured: May 25 16:27:45.924574 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 25 16:27:45.924574 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:27:45.924574 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:27:45.924574 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:27:45.924574 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 122 May 25 16:27:45.924574 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:27:45.924574 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:27:45.924574 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:27:45.924574 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:27:45.924574 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijlkBcjNeM9ayYOO7xwt7NAOgQEAEy4ZIp1imCbi-4thd-l5-KK3Zg2irH1hWTj3_L-_DlZ1p00gOkdVR3y50KY2alrzCtXiyU2dqD31RQM9NwVAMr4SCy1V4O24P5N8NcsuzTeQ-xaoJVTax1bxVtE2bOfWEOKGfv4hZJ450LM2jO60 May 25 16:27:45.924574 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:27:45.924574 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:27:45.924574 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:27:45.924574 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:27:45.924574 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:27:45.924574 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:27:45.924574 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: 8f1295403805438d82a585fb1abd9c2a May 25 16:27:45.924574 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-VolumesNegativeTest-189726527 May 25 16:27:45.924574 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:27:45.924574 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:27:45.926108 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8f1295403805438d82a585fb1abd9c2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8f1295403805438d82a585fb1abd9c2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8f1295403805438d82a585fb1abd9c2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8f1295403805438d82a585fb1abd9c2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:27:45.926108 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-VolumesNegativeTest-189726527 May 25 16:27:45.926108 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: 8f1295403805438d82a585fb1abd9c2a May 25 16:27:45.926108 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-VolumesNegativeTest-189726527 May 25 16:27:45.926108 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-VolumesNegativeTest-189726527-project May 25 16:27:45.926108 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:27:45.926108 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:27:45.926108 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: 5ae4839689d14a95bfe7404d62cb8d08 May 25 16:27:45.926108 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-VolumesNegativeTest-189726527-project May 25 16:27:45.926108 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: May 25 16:27:45.926108 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1743499841", "metadata": {"Type": "work"}}} May 25 16:27:45.926108 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: May 25 16:27:45.926108 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 25 16:27:45.927024 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1743499841', 'metadata': {'Type': 'work'}}}} May 25 16:27:45.927024 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:27:45.927024 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:45.927024 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 25 16:27:45.927024 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 25 16:27:45.927024 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 25 16:27:45.927024 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise error May 25 16:27:45.927024 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 25 16:27:45.927024 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:45.927024 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 25 16:27:45.927024 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 25 16:27:45.927024 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:45.927024 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi On instance['volume']: May 25 16:27:45.927024 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi '#$%' May 25 16:27:45.927024 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:45.927024 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:45.927024 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:45.927024 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:45.927024 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:45.927024 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:45.927024 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:27:45.927024 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:27:45.928480 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 16:27:45.928480 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 16:27:45.928480 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:27:45.928480 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:27:45.928480 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 25 16:27:45.928480 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 25 16:27:45.928480 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 25 16:27:45.928480 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 25 16:27:45.928480 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 25 16:27:45.928480 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 25 16:27:45.928480 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 25 16:27:45.928480 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:45.928480 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:45.928480 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:45.928480 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:45.928480 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:45.928480 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:45.928480 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 25 16:27:45.928480 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 25 16:27:45.929614 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 25 16:27:45.929614 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:45.930615 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-160d9bb9-43e2-4422-87d6-bd796856fe5f tempest-VolumesNegativeTest-189726527 tempest-VolumesNegativeTest-189726527-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:27:45.931612 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-160d9bb9-43e2-4422-87d6-bd796856fe5f tempest-VolumesNegativeTest-189726527 tempest-VolumesNegativeTest-189726527-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.297053 May 25 16:27:45.932761 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 418/828] 10.222.0.42 () {60 vars in 1155 bytes} [Wed May 25 16:27:45 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 299 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 25 16:27:45.942714 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-1a6506b5-3849-41a4-a46d-1880e965d0a4 tempest-VolumesNegativeTest-189726527 tempest-VolumesNegativeTest-189726527-project] Action: 'create', calling method: .version_select at 0x7f51ed8ffc10>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-93520830", "metadata": {"Type": "work"}}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:27:45.946136 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-1a6506b5-3849-41a4-a46d-1880e965d0a4 tempest-VolumesNegativeTest-189726527 tempest-VolumesNegativeTest-189726527-project] Request method failure captured: May 25 16:27:45.946136 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 25 16:27:45.946136 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept: application/json May 25 16:27:45.946136 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept-Encoding: identity May 25 16:27:45.946136 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Connection: close May 25 16:27:45.946136 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Length: 118 May 25 16:27:45.946136 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Type: application/json May 25 16:27:45.946136 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Host: 10.222.0.42 May 25 16:27:45.946136 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Openstack-System-Scope: None May 25 16:27:45.946136 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: User-Agent: python-urllib3/1.26.9 May 25 16:27:45.946136 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Auth-Token: gAAAAABijlkBcjNeM9ayYOO7xwt7NAOgQEAEy4ZIp1imCbi-4thd-l5-KK3Zg2irH1hWTj3_L-_DlZ1p00gOkdVR3y50KY2alrzCtXiyU2dqD31RQM9NwVAMr4SCy1V4O24P5N8NcsuzTeQ-xaoJVTax1bxVtE2bOfWEOKGfv4hZJ450LM2jO60 May 25 16:27:45.946136 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Id: None May 25 16:27:45.946136 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Name: None May 25 16:27:45.946136 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Identity-Status: Confirmed May 25 16:27:45.946136 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Is-Admin-Project: True May 25 16:27:45.946136 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Id: default May 25 16:27:45.946136 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Name: Default May 25 16:27:45.946136 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Id: 8f1295403805438d82a585fb1abd9c2a May 25 16:27:45.946136 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Name: tempest-VolumesNegativeTest-189726527 May 25 16:27:45.946136 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Role: reader,member May 25 16:27:45.946136 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Roles: reader,member May 25 16:27:45.947720 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8f1295403805438d82a585fb1abd9c2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8f1295403805438d82a585fb1abd9c2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8f1295403805438d82a585fb1abd9c2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8f1295403805438d82a585fb1abd9c2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:27:45.947720 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant: tempest-VolumesNegativeTest-189726527 May 25 16:27:45.947720 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Id: 8f1295403805438d82a585fb1abd9c2a May 25 16:27:45.947720 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Name: tempest-VolumesNegativeTest-189726527 May 25 16:27:45.947720 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User: tempest-VolumesNegativeTest-189726527-project May 25 16:27:45.947720 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Id: default May 25 16:27:45.947720 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Name: Default May 25 16:27:45.947720 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Id: 5ae4839689d14a95bfe7404d62cb8d08 May 25 16:27:45.947720 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Name: tempest-VolumesNegativeTest-189726527-project May 25 16:27:45.947720 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: May 25 16:27:45.947720 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-93520830", "metadata": {"Type": "work"}}} May 25 16:27:45.947720 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: method: May 25 16:27:45.947720 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 25 16:27:45.948749 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-93520830', 'metadata': {'Type': 'work'}}}} May 25 16:27:45.948749 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:27:45.948749 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:45.948749 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 25 16:27:45.948749 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 25 16:27:45.948749 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 25 16:27:45.948749 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise error May 25 16:27:45.948749 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 25 16:27:45.948749 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:45.948749 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 25 16:27:45.948749 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 25 16:27:45.948749 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:45.948749 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi On instance['volume']: May 25 16:27:45.948749 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi '0' May 25 16:27:45.948749 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:45.948749 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:45.948749 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:45.948749 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:45.948749 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:45.948749 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:45.948749 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:27:45.948749 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:27:45.950387 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 16:27:45.950387 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 16:27:45.950387 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:27:45.950387 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:27:45.950387 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 25 16:27:45.950387 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 25 16:27:45.950387 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 25 16:27:45.950387 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 25 16:27:45.950387 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 25 16:27:45.950387 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 25 16:27:45.950387 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 25 16:27:45.950387 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:45.950387 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:45.950387 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:45.950387 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:45.950387 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:45.950387 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:45.950387 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 25 16:27:45.950387 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 25 16:27:45.951776 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 25 16:27:45.951776 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:45.953484 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-1a6506b5-3849-41a4-a46d-1880e965d0a4 tempest-VolumesNegativeTest-189726527 tempest-VolumesNegativeTest-189726527-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:27:45.954440 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-1a6506b5-3849-41a4-a46d-1880e965d0a4 tempest-VolumesNegativeTest-189726527 tempest-VolumesNegativeTest-189726527-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015898 May 25 16:27:45.959157 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 411/829] 10.222.0.42 () {60 vars in 1155 bytes} [Wed May 25 16:27:45 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 25 16:27:45.965708 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-c8fdbc82-7346-4c62-bc4e-7268bb206bd9 tempest-VolumesNegativeTest-189726527 tempest-VolumesNegativeTest-189726527-project] Action: 'create', calling method: .version_select at 0x7f51f335c820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1833568370", "metadata": {"Type": "work"}}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:27:45.969058 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-c8fdbc82-7346-4c62-bc4e-7268bb206bd9 tempest-VolumesNegativeTest-189726527 tempest-VolumesNegativeTest-189726527-project] Request method failure captured: May 25 16:27:45.969058 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 25 16:27:45.969058 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:27:45.969058 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:27:45.969058 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:27:45.969058 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 119 May 25 16:27:45.969058 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:27:45.969058 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:27:45.969058 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:27:45.969058 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:27:45.969058 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijlkBcjNeM9ayYOO7xwt7NAOgQEAEy4ZIp1imCbi-4thd-l5-KK3Zg2irH1hWTj3_L-_DlZ1p00gOkdVR3y50KY2alrzCtXiyU2dqD31RQM9NwVAMr4SCy1V4O24P5N8NcsuzTeQ-xaoJVTax1bxVtE2bOfWEOKGfv4hZJ450LM2jO60 May 25 16:27:45.969058 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:27:45.969058 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:27:45.969058 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:27:45.969058 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:27:45.969058 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:27:45.969058 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:27:45.969058 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: 8f1295403805438d82a585fb1abd9c2a May 25 16:27:45.969058 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-VolumesNegativeTest-189726527 May 25 16:27:45.969058 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:27:45.969058 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:27:45.970889 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8f1295403805438d82a585fb1abd9c2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8f1295403805438d82a585fb1abd9c2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8f1295403805438d82a585fb1abd9c2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8f1295403805438d82a585fb1abd9c2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:27:45.970889 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-VolumesNegativeTest-189726527 May 25 16:27:45.970889 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: 8f1295403805438d82a585fb1abd9c2a May 25 16:27:45.970889 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-VolumesNegativeTest-189726527 May 25 16:27:45.970889 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-VolumesNegativeTest-189726527-project May 25 16:27:45.970889 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:27:45.970889 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:27:45.970889 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: 5ae4839689d14a95bfe7404d62cb8d08 May 25 16:27:45.970889 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-VolumesNegativeTest-189726527-project May 25 16:27:45.970889 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: May 25 16:27:45.970889 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1833568370", "metadata": {"Type": "work"}}} May 25 16:27:45.970889 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: May 25 16:27:45.970889 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 25 16:27:45.971866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1833568370', 'metadata': {'Type': 'work'}}}} May 25 16:27:45.971866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:27:45.971866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:45.971866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 25 16:27:45.971866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 25 16:27:45.971866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 25 16:27:45.971866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise error May 25 16:27:45.971866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 25 16:27:45.971866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:45.971866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 25 16:27:45.971866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 25 16:27:45.971866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:45.971866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi On instance['volume']: May 25 16:27:45.971866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi '' May 25 16:27:45.971866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:45.971866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:45.971866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:45.971866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:45.971866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:45.971866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:45.971866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:27:45.971866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:27:45.973788 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 16:27:45.973788 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 16:27:45.973788 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:27:45.973788 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:27:45.973788 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 25 16:27:45.973788 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 25 16:27:45.973788 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 25 16:27:45.973788 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 25 16:27:45.973788 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 25 16:27:45.973788 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 25 16:27:45.973788 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 25 16:27:45.973788 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:45.973788 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:45.973788 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:45.973788 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:45.973788 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:45.973788 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:45.973788 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 25 16:27:45.973788 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 25 16:27:45.975043 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 25 16:27:45.975043 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:45.975043 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-c8fdbc82-7346-4c62-bc4e-7268bb206bd9 tempest-VolumesNegativeTest-189726527 tempest-VolumesNegativeTest-189726527-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:27:45.975043 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-c8fdbc82-7346-4c62-bc4e-7268bb206bd9 tempest-VolumesNegativeTest-189726527 tempest-VolumesNegativeTest-189726527-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011436 May 25 16:27:45.975043 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 419/830] 10.222.0.42 () {60 vars in 1155 bytes} [Wed May 25 16:27:45 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 25 16:27:45.982969 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-662cb2d8-03e4-48e1-bd08-985684fc81cd tempest-VolumesNegativeTest-189726527 tempest-VolumesNegativeTest-189726527-project] Calling method '.version_select at 0x7f51ed8e7550>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:46.018046 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.wsgi [None req-662cb2d8-03e4-48e1-bd08-985684fc81cd tempest-VolumesNegativeTest-189726527 tempest-VolumesNegativeTest-189726527-project] HTTP exception thrown: Volume tempest-invalid-1195782861 could not be found. May 25 16:27:46.019993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-662cb2d8-03e4-48e1-bd08-985684fc81cd tempest-VolumesNegativeTest-189726527 tempest-VolumesNegativeTest-189726527-project] Request method failure captured: May 25 16:27:46.019993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1195782861 HTTP/1.1 May 25 16:27:46.019993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept: application/json May 25 16:27:46.019993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept-Encoding: identity May 25 16:27:46.019993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Connection: close May 25 16:27:46.019993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Length: 0 May 25 16:27:46.019993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Type: application/json May 25 16:27:46.019993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Host: 10.222.0.42 May 25 16:27:46.019993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Openstack-System-Scope: None May 25 16:27:46.019993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: User-Agent: python-urllib3/1.26.9 May 25 16:27:46.019993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Auth-Token: gAAAAABijlkBcjNeM9ayYOO7xwt7NAOgQEAEy4ZIp1imCbi-4thd-l5-KK3Zg2irH1hWTj3_L-_DlZ1p00gOkdVR3y50KY2alrzCtXiyU2dqD31RQM9NwVAMr4SCy1V4O24P5N8NcsuzTeQ-xaoJVTax1bxVtE2bOfWEOKGfv4hZJ450LM2jO60 May 25 16:27:46.019993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Id: None May 25 16:27:46.019993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Name: None May 25 16:27:46.019993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Identity-Status: Confirmed May 25 16:27:46.019993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Is-Admin-Project: True May 25 16:27:46.019993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Id: default May 25 16:27:46.019993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Name: Default May 25 16:27:46.019993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Id: 8f1295403805438d82a585fb1abd9c2a May 25 16:27:46.019993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Name: tempest-VolumesNegativeTest-189726527 May 25 16:27:46.019993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Role: reader,member May 25 16:27:46.019993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Roles: reader,member May 25 16:27:46.021300 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8f1295403805438d82a585fb1abd9c2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8f1295403805438d82a585fb1abd9c2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8f1295403805438d82a585fb1abd9c2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8f1295403805438d82a585fb1abd9c2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:27:46.021300 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant: tempest-VolumesNegativeTest-189726527 May 25 16:27:46.021300 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Id: 8f1295403805438d82a585fb1abd9c2a May 25 16:27:46.021300 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Name: tempest-VolumesNegativeTest-189726527 May 25 16:27:46.021300 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User: tempest-VolumesNegativeTest-189726527-project May 25 16:27:46.021300 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Id: default May 25 16:27:46.021300 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Name: Default May 25 16:27:46.021300 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Id: 5ae4839689d14a95bfe7404d62cb8d08 May 25 16:27:46.021300 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Name: tempest-VolumesNegativeTest-189726527-project May 25 16:27:46.021300 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: method: May 25 16:27:46.021300 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: exception: Volume tempest-invalid-1195782861 could not be found. May 25 16:27:46.021300 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: action_args: {'id': 'tempest-invalid-1195782861'} May 25 16:27:46.021300 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:27:46.022399 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:46.022399 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 16:27:46.022399 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 16:27:46.022399 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 16:27:46.022399 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 16:27:46.022399 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 16:27:46.022399 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 16:27:46.022399 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 16:27:46.022399 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 16:27:46.022399 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 16:27:46.022399 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 16:27:46.022399 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:27:46.022399 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:27:46.022399 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:27:46.022399 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:27:46.022399 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1195782861 could not be found. (HTTP 404) (Request-ID: req-280e5242-d026-4bfe-b0e2-dd56e4680ec8) May 25 16:27:46.022399 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:46.022399 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:46.022399 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:46.023601 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:46.023601 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 25 16:27:46.023601 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 25 16:27:46.023601 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 16:27:46.023601 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 16:27:46.023601 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 16:27:46.023601 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 16:27:46.023601 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 16:27:46.023601 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 16:27:46.023601 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 16:27:46.023601 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 16:27:46.023601 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 16:27:46.023601 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 16:27:46.023601 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 16:27:46.023601 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 16:27:46.023601 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 16:27:46.023601 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 16:27:46.023601 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 16:27:46.023601 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 16:27:46.025322 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:27:46.025322 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:27:46.025322 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:27:46.025322 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:27:46.025322 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1195782861 could not be found. May 25 16:27:46.025322 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:46.025322 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:46.025322 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:46.025322 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:46.025322 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:46.025322 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:46.025322 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:27:46.025322 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:27:46.025322 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 16:27:46.025322 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 16:27:46.025322 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:27:46.025322 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:27:46.025322 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 25 16:27:46.025322 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:27:46.025322 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1195782861 could not be found. May 25 16:27:46.027593 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:46.027593 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:46.027593 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:46.027593 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:46.027593 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:46.027593 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:46.027593 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:27:46.027593 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:27:46.027593 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1195782861 could not be found. May 25 16:27:46.027593 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:46.027593 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-662cb2d8-03e4-48e1-bd08-985684fc81cd tempest-VolumesNegativeTest-189726527 tempest-VolumesNegativeTest-189726527-project] Returning 404 to user: Volume tempest-invalid-1195782861 could not be found. {{(pid=117510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:27:46.027593 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-662cb2d8-03e4-48e1-bd08-985684fc81cd tempest-VolumesNegativeTest-189726527 tempest-VolumesNegativeTest-189726527-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1195782861" status: 404 len: 99 microversion: 2.1 time: 0.042907 May 25 16:27:46.027593 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 412/831] 10.222.0.42 () {58 vars in 1217 bytes} [Wed May 25 16:27:45 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1195782861 => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 25 16:27:46.035870 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-b6bdd572-f5cb-47b5-a643-10160f7fe2bd tempest-VolumesNegativeTest-189726527 tempest-VolumesNegativeTest-189726527-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003601 May 25 16:27:46.036807 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 420/832] 10.222.0.42 () {58 vars in 1139 bytes} [Wed May 25 16:27:46 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 25 16:27:46.048693 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-2847bdb0-8c81-4f6a-aeee-291b8574104a tempest-VolumesNegativeTest-189726527 tempest-VolumesNegativeTest-189726527-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004797 May 25 16:27:46.049379 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 413/833] 10.222.0.42 () {58 vars in 1136 bytes} [Wed May 25 16:27:46 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 25 16:27:46.065540 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-33948593-741c-48ea-a1e2-99adfdff0e24 tempest-VolumesNegativeTest-189726527 tempest-VolumesNegativeTest-189726527-project] Calling method '.version_select at 0x7f51ee165ee0>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:46.092975 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.wsgi [None req-33948593-741c-48ea-a1e2-99adfdff0e24 tempest-VolumesNegativeTest-189726527 tempest-VolumesNegativeTest-189726527-project] HTTP exception thrown: Volume eb9e0e9c-3499-489f-8f22-3b065f3e612e could not be found. May 25 16:27:46.096417 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-33948593-741c-48ea-a1e2-99adfdff0e24 tempest-VolumesNegativeTest-189726527 tempest-VolumesNegativeTest-189726527-project] Request method failure captured: May 25 16:27:46.096417 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: DELETE /compute/v2.1/os-volumes/eb9e0e9c-3499-489f-8f22-3b065f3e612e HTTP/1.1 May 25 16:27:46.096417 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:27:46.096417 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:27:46.096417 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:27:46.096417 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 0 May 25 16:27:46.096417 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:27:46.096417 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:27:46.096417 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:27:46.096417 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:27:46.096417 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijlkBcjNeM9ayYOO7xwt7NAOgQEAEy4ZIp1imCbi-4thd-l5-KK3Zg2irH1hWTj3_L-_DlZ1p00gOkdVR3y50KY2alrzCtXiyU2dqD31RQM9NwVAMr4SCy1V4O24P5N8NcsuzTeQ-xaoJVTax1bxVtE2bOfWEOKGfv4hZJ450LM2jO60 May 25 16:27:46.096417 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:27:46.096417 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:27:46.096417 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:27:46.096417 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:27:46.096417 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:27:46.096417 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:27:46.096417 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: 8f1295403805438d82a585fb1abd9c2a May 25 16:27:46.096417 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-VolumesNegativeTest-189726527 May 25 16:27:46.096417 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:27:46.096417 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:27:46.097797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8f1295403805438d82a585fb1abd9c2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8f1295403805438d82a585fb1abd9c2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8f1295403805438d82a585fb1abd9c2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8f1295403805438d82a585fb1abd9c2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:27:46.097797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-VolumesNegativeTest-189726527 May 25 16:27:46.097797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: 8f1295403805438d82a585fb1abd9c2a May 25 16:27:46.097797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-VolumesNegativeTest-189726527 May 25 16:27:46.097797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-VolumesNegativeTest-189726527-project May 25 16:27:46.097797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:27:46.097797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:27:46.097797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: 5ae4839689d14a95bfe7404d62cb8d08 May 25 16:27:46.097797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-VolumesNegativeTest-189726527-project May 25 16:27:46.097797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: May 25 16:27:46.097797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Volume eb9e0e9c-3499-489f-8f22-3b065f3e612e could not be found. May 25 16:27:46.097797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'id': 'eb9e0e9c-3499-489f-8f22-3b065f3e612e'} May 25 16:27:46.097797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:27:46.103463 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:46.103463 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 16:27:46.103463 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 16:27:46.103463 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 16:27:46.103463 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 16:27:46.103463 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 16:27:46.103463 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 16:27:46.103463 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 16:27:46.103463 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 16:27:46.103463 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 16:27:46.103463 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 16:27:46.103463 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:27:46.103463 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:27:46.103463 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:27:46.103463 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:27:46.103463 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eb9e0e9c-3499-489f-8f22-3b065f3e612e could not be found. (HTTP 404) (Request-ID: req-b7281e8b-4e7a-4a3c-9ad9-435b18abe055) May 25 16:27:46.103463 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:46.103463 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:46.103463 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:46.105611 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:46.105611 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 25 16:27:46.105611 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 25 16:27:46.105611 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 16:27:46.105611 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 16:27:46.105611 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 16:27:46.105611 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 16:27:46.105611 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 16:27:46.105611 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 16:27:46.105611 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 16:27:46.105611 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 16:27:46.105611 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 16:27:46.105611 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 16:27:46.105611 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 16:27:46.105611 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 16:27:46.105611 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 16:27:46.105611 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 16:27:46.105611 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 16:27:46.105611 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 16:27:46.107137 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:27:46.107137 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:27:46.107137 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:27:46.107137 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:27:46.107137 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eb9e0e9c-3499-489f-8f22-3b065f3e612e could not be found. May 25 16:27:46.107137 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:46.107137 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:46.107137 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:46.107137 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:46.107137 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:46.107137 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:46.107137 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:27:46.107137 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:27:46.107137 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 16:27:46.107137 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 16:27:46.107137 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:27:46.107137 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:27:46.107137 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 25 16:27:46.107137 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:27:46.108493 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eb9e0e9c-3499-489f-8f22-3b065f3e612e could not be found. May 25 16:27:46.108493 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:46.108493 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:46.108493 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:46.108493 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:46.108493 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:46.108493 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:46.108493 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:27:46.108493 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:27:46.108493 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eb9e0e9c-3499-489f-8f22-3b065f3e612e could not be found. May 25 16:27:46.108493 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:27:46.108493 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-33948593-741c-48ea-a1e2-99adfdff0e24 tempest-VolumesNegativeTest-189726527 tempest-VolumesNegativeTest-189726527-project] Returning 404 to user: Volume eb9e0e9c-3499-489f-8f22-3b065f3e612e could not be found. {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:27:46.108493 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-33948593-741c-48ea-a1e2-99adfdff0e24 tempest-VolumesNegativeTest-189726527 tempest-VolumesNegativeTest-189726527-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/eb9e0e9c-3499-489f-8f22-3b065f3e612e" status: 404 len: 109 microversion: 2.1 time: 0.043487 May 25 16:27:46.108493 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 421/834] 10.222.0.42 () {58 vars in 1247 bytes} [Wed May 25 16:27:46 2022] DELETE /compute/v2.1/os-volumes/eb9e0e9c-3499-489f-8f22-3b065f3e612e => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:27:46.115519 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-ca7b80c6-4f84-41a7-a207-0360fd12faca tempest-VolumesNegativeTest-189726527 tempest-VolumesNegativeTest-189726527-project] Calling method '.version_select at 0x7f51f32b1af0>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:46.152642 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.wsgi [None req-ca7b80c6-4f84-41a7-a207-0360fd12faca tempest-VolumesNegativeTest-189726527 tempest-VolumesNegativeTest-189726527-project] HTTP exception thrown: Volume efdc36fe-af80-40d2-b828-aa3b4cb4cc45 could not be found. May 25 16:27:46.154710 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-ca7b80c6-4f84-41a7-a207-0360fd12faca tempest-VolumesNegativeTest-189726527 tempest-VolumesNegativeTest-189726527-project] Request method failure captured: May 25 16:27:46.154710 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: request: GET /compute/v2.1/os-volumes/efdc36fe-af80-40d2-b828-aa3b4cb4cc45 HTTP/1.1 May 25 16:27:46.154710 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept: application/json May 25 16:27:46.154710 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept-Encoding: identity May 25 16:27:46.154710 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Connection: close May 25 16:27:46.154710 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Length: 0 May 25 16:27:46.154710 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Type: application/json May 25 16:27:46.154710 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Host: 10.222.0.42 May 25 16:27:46.154710 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Openstack-System-Scope: None May 25 16:27:46.154710 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: User-Agent: python-urllib3/1.26.9 May 25 16:27:46.154710 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Auth-Token: gAAAAABijlkBcjNeM9ayYOO7xwt7NAOgQEAEy4ZIp1imCbi-4thd-l5-KK3Zg2irH1hWTj3_L-_DlZ1p00gOkdVR3y50KY2alrzCtXiyU2dqD31RQM9NwVAMr4SCy1V4O24P5N8NcsuzTeQ-xaoJVTax1bxVtE2bOfWEOKGfv4hZJ450LM2jO60 May 25 16:27:46.154710 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Id: None May 25 16:27:46.154710 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Name: None May 25 16:27:46.154710 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Identity-Status: Confirmed May 25 16:27:46.154710 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Is-Admin-Project: True May 25 16:27:46.154710 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Id: default May 25 16:27:46.154710 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Name: Default May 25 16:27:46.154710 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Id: 8f1295403805438d82a585fb1abd9c2a May 25 16:27:46.154710 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Name: tempest-VolumesNegativeTest-189726527 May 25 16:27:46.154710 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Role: reader,member May 25 16:27:46.154710 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Roles: reader,member May 25 16:27:46.156132 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8f1295403805438d82a585fb1abd9c2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8f1295403805438d82a585fb1abd9c2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8f1295403805438d82a585fb1abd9c2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8f1295403805438d82a585fb1abd9c2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:27:46.156132 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant: tempest-VolumesNegativeTest-189726527 May 25 16:27:46.156132 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Id: 8f1295403805438d82a585fb1abd9c2a May 25 16:27:46.156132 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Name: tempest-VolumesNegativeTest-189726527 May 25 16:27:46.156132 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User: tempest-VolumesNegativeTest-189726527-project May 25 16:27:46.156132 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Id: default May 25 16:27:46.156132 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Name: Default May 25 16:27:46.156132 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Id: 5ae4839689d14a95bfe7404d62cb8d08 May 25 16:27:46.156132 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Name: tempest-VolumesNegativeTest-189726527-project May 25 16:27:46.156132 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: method: May 25 16:27:46.156132 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: exception: Volume efdc36fe-af80-40d2-b828-aa3b4cb4cc45 could not be found. May 25 16:27:46.156132 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: action_args: {'id': 'efdc36fe-af80-40d2-b828-aa3b4cb4cc45'} May 25 16:27:46.156132 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:27:46.156921 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:46.156921 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 16:27:46.156921 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 16:27:46.156921 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 16:27:46.156921 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 16:27:46.156921 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 16:27:46.156921 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 16:27:46.156921 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 16:27:46.156921 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 16:27:46.156921 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 16:27:46.156921 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 16:27:46.156921 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:27:46.156921 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:27:46.156921 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:27:46.156921 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:27:46.156921 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume efdc36fe-af80-40d2-b828-aa3b4cb4cc45 could not be found. (HTTP 404) (Request-ID: req-47b37894-6bf1-4afb-8a45-6affe7e2a656) May 25 16:27:46.156921 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:46.156921 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:46.156921 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:46.158936 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:46.158936 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 25 16:27:46.158936 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 25 16:27:46.158936 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 16:27:46.158936 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 16:27:46.158936 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 16:27:46.158936 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 16:27:46.158936 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 16:27:46.158936 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 16:27:46.158936 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 16:27:46.158936 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 16:27:46.158936 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 16:27:46.158936 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 16:27:46.158936 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 16:27:46.158936 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 16:27:46.158936 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 16:27:46.158936 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 16:27:46.158936 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 16:27:46.158936 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 16:27:46.162299 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:27:46.162299 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:27:46.162299 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:27:46.162299 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:27:46.162299 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume efdc36fe-af80-40d2-b828-aa3b4cb4cc45 could not be found. May 25 16:27:46.162299 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:46.162299 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:46.162299 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:46.162299 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:46.162299 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:46.162299 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:46.162299 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:27:46.162299 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:27:46.162299 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 16:27:46.162299 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 16:27:46.162299 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:27:46.162299 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:27:46.162299 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 25 16:27:46.162299 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:27:46.164611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume efdc36fe-af80-40d2-b828-aa3b4cb4cc45 could not be found. May 25 16:27:46.164611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:46.164611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:27:46.164611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:46.164611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:27:46.164611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:27:46.164611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:27:46.164611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:27:46.164611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:27:46.164611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume efdc36fe-af80-40d2-b828-aa3b4cb4cc45 could not be found. May 25 16:27:46.164611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:27:46.164611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-ca7b80c6-4f84-41a7-a207-0360fd12faca tempest-VolumesNegativeTest-189726527 tempest-VolumesNegativeTest-189726527-project] Returning 404 to user: Volume efdc36fe-af80-40d2-b828-aa3b4cb4cc45 could not be found. {{(pid=117510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:27:46.164611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-ca7b80c6-4f84-41a7-a207-0360fd12faca tempest-VolumesNegativeTest-189726527 tempest-VolumesNegativeTest-189726527-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/efdc36fe-af80-40d2-b828-aa3b4cb4cc45" status: 404 len: 109 microversion: 2.1 time: 0.045312 May 25 16:27:46.164611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 414/835] 10.222.0.42 () {58 vars in 1244 bytes} [Wed May 25 16:27:46 2022] GET /compute/v2.1/os-volumes/efdc36fe-af80-40d2-b828-aa3b4cb4cc45 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:27:53.414114 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_api:SELECT=5 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:27:53.415368 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=33 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:27:53.420374 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-a005d58e-d1c8-4fc4-ae39-bfabeaac8e10 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1381699225", "imageRef": "e74cccc1-cd1b-4dfc-8e47-3e4a832649a8", "flavorRef": "452", "networks": [{"uuid": "6baa21b1-34f5-4c8e-82eb-998cf516fa1e"}]}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:27:53.476620 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.network.neutron [None req-a005d58e-d1c8-4fc4-ae39-bfabeaac8e10 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] validate_networks() for [('6baa21b1-34f5-4c8e-82eb-998cf516fa1e', None, None, None, None, None)] {{(pid=117509) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:27:53.883790 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-a005d58e-d1c8-4fc4-ae39-bfabeaac8e10 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Flavor limits 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:27:53.884260 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-a005d58e-d1c8-4fc4-ae39-bfabeaac8e10 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Image limits 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:27:53.884733 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-a005d58e-d1c8-4fc4-ae39-bfabeaac8e10 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Flavor pref 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:27:53.885145 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-a005d58e-d1c8-4fc4-ae39-bfabeaac8e10 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Image pref 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:27:53.886579 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-a005d58e-d1c8-4fc4-ae39-bfabeaac8e10 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:27:53.896970 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a005d58e-d1c8-4fc4-ae39-bfabeaac8e10 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:53.897407 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a005d58e-d1c8-4fc4-ae39-bfabeaac8e10 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:53.898218 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a005d58e-d1c8-4fc4-ae39-bfabeaac8e10 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:53.898883 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a005d58e-d1c8-4fc4-ae39-bfabeaac8e10 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:53.920111 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-a005d58e-d1c8-4fc4-ae39-bfabeaac8e10 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Getting quotas for project 1fe1de3697c04df4865c4a145a524231. Resources: {'ram', 'cores', 'instances'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:27:53.924236 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-a005d58e-d1c8-4fc4-ae39-bfabeaac8e10 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Getting quotas for user b36eda4f44b9428d9ff648979059fb5b and project 1fe1de3697c04df4865c4a145a524231. Resources: {'ram', 'cores', 'instances'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:27:53.936732 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-a005d58e-d1c8-4fc4-ae39-bfabeaac8e10 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Going to run 1 instances... {{(pid=117509) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:27:53.939045 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-a005d58e-d1c8-4fc4-ae39-bfabeaac8e10 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 5c8f4ac3-2425-4805-8498-5814868636e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e74cccc1-cd1b-4dfc-8e47-3e4a832649a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:27:53.993860 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-a005d58e-d1c8-4fc4-ae39-bfabeaac8e10 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580959 May 25 16:27:53.994896 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 422/836] 10.222.0.42 () {60 vars in 1146 bytes} [Wed May 25 16:27:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:27:54.004699 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:27:54.005510 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:27:54.010138 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-6fbfb44b-804d-48d9-b7b8-10b14f53728b tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:54.010883 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-6fbfb44b-804d-48d9-b7b8-10b14f53728b tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 5c8f4ac3-2425-4805-8498-5814868636e7] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:54.075174 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-6fbfb44b-804d-48d9-b7b8-10b14f53728b tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36eda4f44b9428d9ff648979059fb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe1de3697c04df4865c4a145a524231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:27:54.083964 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-6fbfb44b-804d-48d9-b7b8-10b14f53728b tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "GET /compute/v2.1/servers/5c8f4ac3-2425-4805-8498-5814868636e7" status: 200 len: 1214 microversion: 2.1 time: 0.083186 May 25 16:27:54.085080 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 415/837] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:27:53 2022] GET /compute/v2.1/servers/5c8f4ac3-2425-4805-8498-5814868636e7 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:27:55.105965 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-3bf5d423-2969-4505-9d9c-eb127cc7a8fb tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:55.107258 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-3bf5d423-2969-4505-9d9c-eb127cc7a8fb tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 5c8f4ac3-2425-4805-8498-5814868636e7] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:55.115433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3bf5d423-2969-4505-9d9c-eb127cc7a8fb tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:55.116319 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3bf5d423-2969-4505-9d9c-eb127cc7a8fb tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:55.119229 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3bf5d423-2969-4505-9d9c-eb127cc7a8fb tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:55.120199 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3bf5d423-2969-4505-9d9c-eb127cc7a8fb tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:55.222894 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-3bf5d423-2969-4505-9d9c-eb127cc7a8fb tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36eda4f44b9428d9ff648979059fb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe1de3697c04df4865c4a145a524231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:27:55.230645 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-3bf5d423-2969-4505-9d9c-eb127cc7a8fb tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "GET /compute/v2.1/servers/5c8f4ac3-2425-4805-8498-5814868636e7" status: 200 len: 1272 microversion: 2.1 time: 0.130908 May 25 16:27:55.231454 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 423/838] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:27:55 2022] GET /compute/v2.1/servers/5c8f4ac3-2425-4805-8498-5814868636e7 => generated 1272 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:27:55.602324 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-5d0aac7c-fdce-4355-9043-b579f0098307 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-43835627", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1857624386", "security_groups": [{"name": "tempest-secgroup-smoke-1860376157"}], "block_device_mapping_v2": [{"uuid": "08c26350-4cc5-47da-a1e6-8d466db400b7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5f7c259b-fa42-4f62-9149-4145e768ec9c"}]}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:27:55.746818 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.network.neutron [None req-5d0aac7c-fdce-4355-9043-b579f0098307 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] validate_networks() for [('5f7c259b-fa42-4f62-9149-4145e768ec9c', None, None, None, None, None)] {{(pid=117510) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:27:56.127353 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-5d0aac7c-fdce-4355-9043-b579f0098307 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Flavor limits 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:27:56.127773 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-5d0aac7c-fdce-4355-9043-b579f0098307 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Image limits 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:27:56.128245 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-5d0aac7c-fdce-4355-9043-b579f0098307 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Flavor pref 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:27:56.128652 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-5d0aac7c-fdce-4355-9043-b579f0098307 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Image pref 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:27:56.129059 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-5d0aac7c-fdce-4355-9043-b579f0098307 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:27:56.137974 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5d0aac7c-fdce-4355-9043-b579f0098307 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:56.138423 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5d0aac7c-fdce-4355-9043-b579f0098307 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:56.139220 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5d0aac7c-fdce-4355-9043-b579f0098307 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:56.139654 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5d0aac7c-fdce-4355-9043-b579f0098307 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:56.157162 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-5d0aac7c-fdce-4355-9043-b579f0098307 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Getting quotas for project a40431f830294ea0a6395be072560dea. Resources: {'ram', 'cores', 'instances'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:27:56.161578 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-5d0aac7c-fdce-4355-9043-b579f0098307 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Getting quotas for user c935f035c757482ca912a8c4b77714a0 and project a40431f830294ea0a6395be072560dea. Resources: {'ram', 'cores', 'instances'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:27:56.243940 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-5d0aac7c-fdce-4355-9043-b579f0098307 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Going to run 1 instances... {{(pid=117510) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:27:56.246662 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-5d0aac7c-fdce-4355-9043-b579f0098307 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: be25cf4d-733b-4999-b6d9-474da04a6444] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='08c26350-4cc5-47da-a1e6-8d466db400b7',volume_size=None,volume_type=None)] {{(pid=117510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:27:56.249258 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-5e2ce0bb-8ef1-4d6b-b0d3-bc612aebbe2b tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:56.250679 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-5e2ce0bb-8ef1-4d6b-b0d3-bc612aebbe2b tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 5c8f4ac3-2425-4805-8498-5814868636e7] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:56.257630 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5e2ce0bb-8ef1-4d6b-b0d3-bc612aebbe2b tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:56.258604 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5e2ce0bb-8ef1-4d6b-b0d3-bc612aebbe2b tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:56.260212 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5e2ce0bb-8ef1-4d6b-b0d3-bc612aebbe2b tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:56.261137 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5e2ce0bb-8ef1-4d6b-b0d3-bc612aebbe2b tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:56.409306 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-5d0aac7c-fdce-4355-9043-b579f0098307 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.810388 May 25 16:27:56.410327 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 416/839] 10.222.0.42 () {60 vars in 1146 bytes} [Wed May 25 16:27:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:27:56.442504 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-042b692b-86fa-4a7f-96dc-5dc12402ce8d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:56.445034 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-042b692b-86fa-4a7f-96dc-5dc12402ce8d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: be25cf4d-733b-4999-b6d9-474da04a6444] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:56.451824 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-5e2ce0bb-8ef1-4d6b-b0d3-bc612aebbe2b tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36eda4f44b9428d9ff648979059fb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe1de3697c04df4865c4a145a524231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:27:56.459952 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-5e2ce0bb-8ef1-4d6b-b0d3-bc612aebbe2b tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "GET /compute/v2.1/servers/5c8f4ac3-2425-4805-8498-5814868636e7" status: 200 len: 1314 microversion: 2.1 time: 0.216177 May 25 16:27:56.460604 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 424/840] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:27:56 2022] GET /compute/v2.1/servers/5c8f4ac3-2425-4805-8498-5814868636e7 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:27:56.535375 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-042b692b-86fa-4a7f-96dc-5dc12402ce8d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:27:56.544493 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-042b692b-86fa-4a7f-96dc-5dc12402ce8d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444" status: 200 len: 1093 microversion: 2.1 time: 0.121317 May 25 16:27:56.546555 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 417/841] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:27:56 2022] GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444 => generated 1093 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:27:56.719231 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-956d5a93-52ff-4654-9bfc-1eb1bca98c18 req-2f45bc6b-fe46-4b13-8c43-f3e2988e3970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c8f4ac3-2425-4805-8498-5814868636e7", "tag": "e355d9a6-ffa7-4027-a9ca-7fc0db0b35b9"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:27:56.731759 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-956d5a93-52ff-4654-9bfc-1eb1bca98c18 req-2f45bc6b-fe46-4b13-8c43-f3e2988e3970 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:56.738696 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-956d5a93-52ff-4654-9bfc-1eb1bca98c18 req-2f45bc6b-fe46-4b13-8c43-f3e2988e3970 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:56.761966 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-956d5a93-52ff-4654-9bfc-1eb1bca98c18 req-2f45bc6b-fe46-4b13-8c43-f3e2988e3970 service nova] Creating event network-changed:e355d9a6-ffa7-4027-a9ca-7fc0db0b35b9 for instance 5c8f4ac3-2425-4805-8498-5814868636e7 on hv-cinder-84327 May 25 16:27:56.767203 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-956d5a93-52ff-4654-9bfc-1eb1bca98c18 req-2f45bc6b-fe46-4b13-8c43-f3e2988e3970 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051905 May 25 16:27:56.768310 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 425/842] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:27:57.477881 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-cb1b891a-bcc3-4a41-8781-3caf26f882ad tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:57.478498 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-cb1b891a-bcc3-4a41-8781-3caf26f882ad tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 5c8f4ac3-2425-4805-8498-5814868636e7] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:57.486381 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-cb1b891a-bcc3-4a41-8781-3caf26f882ad tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:57.486831 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-cb1b891a-bcc3-4a41-8781-3caf26f882ad tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:57.487639 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-cb1b891a-bcc3-4a41-8781-3caf26f882ad tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:57.488174 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-cb1b891a-bcc3-4a41-8781-3caf26f882ad tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:57.567676 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-c96dc73a-02e2-4f32-b9e1-f3ef53685880 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:57.568452 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-c96dc73a-02e2-4f32-b9e1-f3ef53685880 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: be25cf4d-733b-4999-b6d9-474da04a6444] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:57.575948 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c96dc73a-02e2-4f32-b9e1-f3ef53685880 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:57.576401 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c96dc73a-02e2-4f32-b9e1-f3ef53685880 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:57.577411 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c96dc73a-02e2-4f32-b9e1-f3ef53685880 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:57.577906 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c96dc73a-02e2-4f32-b9e1-f3ef53685880 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:57.665727 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-c96dc73a-02e2-4f32-b9e1-f3ef53685880 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:27:57.670735 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-cb1b891a-bcc3-4a41-8781-3caf26f882ad tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36eda4f44b9428d9ff648979059fb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe1de3697c04df4865c4a145a524231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:27:57.676561 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-c96dc73a-02e2-4f32-b9e1-f3ef53685880 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444" status: 200 len: 1191 microversion: 2.1 time: 0.115668 May 25 16:27:57.677331 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 426/843] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:27:57 2022] GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444 => generated 1191 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:27:57.679200 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-cb1b891a-bcc3-4a41-8781-3caf26f882ad tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "GET /compute/v2.1/servers/5c8f4ac3-2425-4805-8498-5814868636e7" status: 200 len: 1314 microversion: 2.1 time: 0.205304 May 25 16:27:57.679849 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 418/844] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:27:57 2022] GET /compute/v2.1/servers/5c8f4ac3-2425-4805-8498-5814868636e7 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:27:58.698000 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-e2557324-19b3-480b-ad81-e9bede5b749b tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:58.698826 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-22c6edd0-5419-463b-b54a-dc258abd05bb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:58.699559 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-22c6edd0-5419-463b-b54a-dc258abd05bb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: be25cf4d-733b-4999-b6d9-474da04a6444] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:58.700194 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-e2557324-19b3-480b-ad81-e9bede5b749b tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 5c8f4ac3-2425-4805-8498-5814868636e7] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:58.707666 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-22c6edd0-5419-463b-b54a-dc258abd05bb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:58.708025 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e2557324-19b3-480b-ad81-e9bede5b749b tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:58.708205 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-22c6edd0-5419-463b-b54a-dc258abd05bb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:58.708431 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e2557324-19b3-480b-ad81-e9bede5b749b tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:58.709092 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-22c6edd0-5419-463b-b54a-dc258abd05bb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:58.709359 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e2557324-19b3-480b-ad81-e9bede5b749b tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:58.709611 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-22c6edd0-5419-463b-b54a-dc258abd05bb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:58.709913 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e2557324-19b3-480b-ad81-e9bede5b749b tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:58.803979 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-22c6edd0-5419-463b-b54a-dc258abd05bb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:27:58.813989 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-22c6edd0-5419-463b-b54a-dc258abd05bb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444" status: 200 len: 1209 microversion: 2.1 time: 0.121238 May 25 16:27:58.814564 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 427/845] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:27:58 2022] GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444 => generated 1209 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:27:58.889138 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-e2557324-19b3-480b-ad81-e9bede5b749b tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36eda4f44b9428d9ff648979059fb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe1de3697c04df4865c4a145a524231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:27:58.896877 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-e2557324-19b3-480b-ad81-e9bede5b749b tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "GET /compute/v2.1/servers/5c8f4ac3-2425-4805-8498-5814868636e7" status: 200 len: 1314 microversion: 2.1 time: 0.203471 May 25 16:27:58.897532 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 419/846] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:27:58 2022] GET /compute/v2.1/servers/5c8f4ac3-2425-4805-8498-5814868636e7 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:27:59.832238 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-c1424a1d-b081-4817-a697-73561d32d805 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:59.833010 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-c1424a1d-b081-4817-a697-73561d32d805 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: be25cf4d-733b-4999-b6d9-474da04a6444] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:59.841823 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c1424a1d-b081-4817-a697-73561d32d805 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:59.842895 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c1424a1d-b081-4817-a697-73561d32d805 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:59.843869 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c1424a1d-b081-4817-a697-73561d32d805 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:59.844412 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c1424a1d-b081-4817-a697-73561d32d805 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:59.921063 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-9a0cf0d9-498d-4217-bf71-1a00bb1e1596 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:27:59.923842 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-9a0cf0d9-498d-4217-bf71-1a00bb1e1596 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 5c8f4ac3-2425-4805-8498-5814868636e7] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:27:59.952551 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9a0cf0d9-498d-4217-bf71-1a00bb1e1596 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:59.954299 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9a0cf0d9-498d-4217-bf71-1a00bb1e1596 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:27:59.955322 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9a0cf0d9-498d-4217-bf71-1a00bb1e1596 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:27:59.956419 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9a0cf0d9-498d-4217-bf71-1a00bb1e1596 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:00.023575 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-c1424a1d-b081-4817-a697-73561d32d805 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:00.040336 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-c1424a1d-b081-4817-a697-73561d32d805 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444" status: 200 len: 1265 microversion: 2.1 time: 0.211841 May 25 16:28:00.040930 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 428/847] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:27:59 2022] GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:28:00.182520 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-67bd66bf-350f-4318-9988-8749545b999a req-f432ea5f-2c14-4441-a281-c58c8518bc41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be25cf4d-733b-4999-b6d9-474da04a6444", "tag": "28e24d33-7178-4533-933f-ce0069b847bd"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:28:00.183812 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-9a0cf0d9-498d-4217-bf71-1a00bb1e1596 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36eda4f44b9428d9ff648979059fb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe1de3697c04df4865c4a145a524231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:00.195182 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-67bd66bf-350f-4318-9988-8749545b999a req-f432ea5f-2c14-4441-a281-c58c8518bc41 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:00.198693 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-67bd66bf-350f-4318-9988-8749545b999a req-f432ea5f-2c14-4441-a281-c58c8518bc41 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:00.204838 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-9a0cf0d9-498d-4217-bf71-1a00bb1e1596 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "GET /compute/v2.1/servers/5c8f4ac3-2425-4805-8498-5814868636e7" status: 200 len: 1314 microversion: 2.1 time: 0.293364 May 25 16:28:00.223860 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 420/848] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:27:59 2022] GET /compute/v2.1/servers/5c8f4ac3-2425-4805-8498-5814868636e7 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:28:00.227558 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-67bd66bf-350f-4318-9988-8749545b999a req-f432ea5f-2c14-4441-a281-c58c8518bc41 service nova] Creating event network-changed:28e24d33-7178-4533-933f-ce0069b847bd for instance be25cf4d-733b-4999-b6d9-474da04a6444 on hv-cinder-84327 May 25 16:28:00.237167 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-67bd66bf-350f-4318-9988-8749545b999a req-f432ea5f-2c14-4441-a281-c58c8518bc41 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058383 May 25 16:28:00.237880 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 429/849] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:28:01.058167 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-658ef193-87eb-4b54-bf95-0233e2e01212 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:01.058789 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-658ef193-87eb-4b54-bf95-0233e2e01212 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: be25cf4d-733b-4999-b6d9-474da04a6444] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:01.065318 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-658ef193-87eb-4b54-bf95-0233e2e01212 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:01.066033 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-658ef193-87eb-4b54-bf95-0233e2e01212 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:01.066984 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-658ef193-87eb-4b54-bf95-0233e2e01212 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:01.067423 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-658ef193-87eb-4b54-bf95-0233e2e01212 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:01.204056 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-658ef193-87eb-4b54-bf95-0233e2e01212 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:01.211514 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-658ef193-87eb-4b54-bf95-0233e2e01212 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444" status: 200 len: 1265 microversion: 2.1 time: 0.158059 May 25 16:28:01.212074 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 421/850] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:01 2022] GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:28:01.224663 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-5887aa1f-288b-4e7b-a635-b103b6f8a8a7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:01.225364 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-5887aa1f-288b-4e7b-a635-b103b6f8a8a7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 5c8f4ac3-2425-4805-8498-5814868636e7] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:01.232316 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5887aa1f-288b-4e7b-a635-b103b6f8a8a7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:01.232764 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5887aa1f-288b-4e7b-a635-b103b6f8a8a7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:01.233531 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5887aa1f-288b-4e7b-a635-b103b6f8a8a7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:01.233994 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5887aa1f-288b-4e7b-a635-b103b6f8a8a7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:01.365774 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-5887aa1f-288b-4e7b-a635-b103b6f8a8a7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36eda4f44b9428d9ff648979059fb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe1de3697c04df4865c4a145a524231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:01.374673 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-5887aa1f-288b-4e7b-a635-b103b6f8a8a7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "GET /compute/v2.1/servers/5c8f4ac3-2425-4805-8498-5814868636e7" status: 200 len: 1314 microversion: 2.1 time: 0.154847 May 25 16:28:01.375457 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 430/851] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:01 2022] GET /compute/v2.1/servers/5c8f4ac3-2425-4805-8498-5814868636e7 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:28:02.228618 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-f0728a0f-ffe3-40df-8626-54419f7ce827 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:02.230044 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-f0728a0f-ffe3-40df-8626-54419f7ce827 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: be25cf4d-733b-4999-b6d9-474da04a6444] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:02.236710 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f0728a0f-ffe3-40df-8626-54419f7ce827 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:02.237150 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f0728a0f-ffe3-40df-8626-54419f7ce827 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:02.237929 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f0728a0f-ffe3-40df-8626-54419f7ce827 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:02.238442 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f0728a0f-ffe3-40df-8626-54419f7ce827 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:02.373166 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-f0728a0f-ffe3-40df-8626-54419f7ce827 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:02.380574 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-f0728a0f-ffe3-40df-8626-54419f7ce827 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444" status: 200 len: 1265 microversion: 2.1 time: 0.156035 May 25 16:28:02.381140 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 422/852] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:02 2022] GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:28:02.391329 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-f5344d35-f313-4f65-8e2e-c7589dbb2a12 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:02.391930 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-f5344d35-f313-4f65-8e2e-c7589dbb2a12 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 5c8f4ac3-2425-4805-8498-5814868636e7] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:02.398203 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f5344d35-f313-4f65-8e2e-c7589dbb2a12 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:02.398640 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f5344d35-f313-4f65-8e2e-c7589dbb2a12 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:02.399385 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f5344d35-f313-4f65-8e2e-c7589dbb2a12 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:02.399810 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f5344d35-f313-4f65-8e2e-c7589dbb2a12 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:02.528164 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-f5344d35-f313-4f65-8e2e-c7589dbb2a12 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36eda4f44b9428d9ff648979059fb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe1de3697c04df4865c4a145a524231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:02.535506 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-f5344d35-f313-4f65-8e2e-c7589dbb2a12 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "GET /compute/v2.1/servers/5c8f4ac3-2425-4805-8498-5814868636e7" status: 200 len: 1314 microversion: 2.1 time: 0.147956 May 25 16:28:02.536314 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 431/853] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:02 2022] GET /compute/v2.1/servers/5c8f4ac3-2425-4805-8498-5814868636e7 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:28:02.746188 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-afeda57a-8eac-4b05-99d7-953818ab86cf req-3ee9cb4b-2764-49ba-87ba-d1a747e580d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c8f4ac3-2425-4805-8498-5814868636e7", "name": "network-vif-plugged", "status": "completed", "tag": "e355d9a6-ffa7-4027-a9ca-7fc0db0b35b9"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:28:02.747980 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-afeda57a-8eac-4b05-99d7-953818ab86cf req-3ee9cb4b-2764-49ba-87ba-d1a747e580d1 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:02.748489 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-afeda57a-8eac-4b05-99d7-953818ab86cf req-3ee9cb4b-2764-49ba-87ba-d1a747e580d1 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:02.761235 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-afeda57a-8eac-4b05-99d7-953818ab86cf req-3ee9cb4b-2764-49ba-87ba-d1a747e580d1 service nova] Creating event network-vif-plugged:e355d9a6-ffa7-4027-a9ca-7fc0db0b35b9 for instance 5c8f4ac3-2425-4805-8498-5814868636e7 on hv-cinder-84327 May 25 16:28:02.766370 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-afeda57a-8eac-4b05-99d7-953818ab86cf req-3ee9cb4b-2764-49ba-87ba-d1a747e580d1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031759 May 25 16:28:02.766963 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 423/854] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:28:03.397686 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-3b70149c-2bb7-46db-9fcf-9cf37e788b01 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:03.398333 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-3b70149c-2bb7-46db-9fcf-9cf37e788b01 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: be25cf4d-733b-4999-b6d9-474da04a6444] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:03.404861 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3b70149c-2bb7-46db-9fcf-9cf37e788b01 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:03.405341 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3b70149c-2bb7-46db-9fcf-9cf37e788b01 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:03.406133 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3b70149c-2bb7-46db-9fcf-9cf37e788b01 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:03.406592 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3b70149c-2bb7-46db-9fcf-9cf37e788b01 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:03.546435 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-3b70149c-2bb7-46db-9fcf-9cf37e788b01 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:03.552831 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-cdc7cbd9-663e-409e-b9c3-8bfda7aee023 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:03.553614 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-cdc7cbd9-663e-409e-b9c3-8bfda7aee023 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 5c8f4ac3-2425-4805-8498-5814868636e7] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:03.553955 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-3b70149c-2bb7-46db-9fcf-9cf37e788b01 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444" status: 200 len: 1265 microversion: 2.1 time: 0.160134 May 25 16:28:03.554524 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 432/855] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:03 2022] GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:28:03.560561 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-cdc7cbd9-663e-409e-b9c3-8bfda7aee023 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:03.561010 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-cdc7cbd9-663e-409e-b9c3-8bfda7aee023 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:03.561808 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-cdc7cbd9-663e-409e-b9c3-8bfda7aee023 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:03.562248 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-cdc7cbd9-663e-409e-b9c3-8bfda7aee023 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:03.696125 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-cdc7cbd9-663e-409e-b9c3-8bfda7aee023 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36eda4f44b9428d9ff648979059fb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe1de3697c04df4865c4a145a524231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:03.703850 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-cdc7cbd9-663e-409e-b9c3-8bfda7aee023 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "GET /compute/v2.1/servers/5c8f4ac3-2425-4805-8498-5814868636e7" status: 200 len: 1314 microversion: 2.1 time: 0.155266 May 25 16:28:03.704684 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 424/856] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:03 2022] GET /compute/v2.1/servers/5c8f4ac3-2425-4805-8498-5814868636e7 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:28:04.569845 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-fe6cb3fd-fc8c-45c3-aa26-bbaa86c3b113 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:04.570521 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-fe6cb3fd-fc8c-45c3-aa26-bbaa86c3b113 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: be25cf4d-733b-4999-b6d9-474da04a6444] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:04.573200 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell0:SELECT=2 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:28:04.574333 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell0:SELECT=6 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:28:04.583761 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fe6cb3fd-fc8c-45c3-aa26-bbaa86c3b113 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:04.583761 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fe6cb3fd-fc8c-45c3-aa26-bbaa86c3b113 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:04.583761 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fe6cb3fd-fc8c-45c3-aa26-bbaa86c3b113 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:04.583761 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-fe6cb3fd-fc8c-45c3-aa26-bbaa86c3b113 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:04.720696 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-fe6cb3fd-fc8c-45c3-aa26-bbaa86c3b113 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:04.721376 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-5b8ab464-b9d8-4294-b8be-6071ac1d253e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:04.722170 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-5b8ab464-b9d8-4294-b8be-6071ac1d253e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 5c8f4ac3-2425-4805-8498-5814868636e7] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:04.727825 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-fe6cb3fd-fc8c-45c3-aa26-bbaa86c3b113 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444" status: 200 len: 1265 microversion: 2.1 time: 0.161955 May 25 16:28:04.728494 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 433/857] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:04 2022] GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:28:04.738474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5b8ab464-b9d8-4294-b8be-6071ac1d253e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:04.738937 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5b8ab464-b9d8-4294-b8be-6071ac1d253e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:04.739760 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5b8ab464-b9d8-4294-b8be-6071ac1d253e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:04.740202 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5b8ab464-b9d8-4294-b8be-6071ac1d253e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:04.875994 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-5b8ab464-b9d8-4294-b8be-6071ac1d253e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36eda4f44b9428d9ff648979059fb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe1de3697c04df4865c4a145a524231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:04.884019 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-5b8ab464-b9d8-4294-b8be-6071ac1d253e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "GET /compute/v2.1/servers/5c8f4ac3-2425-4805-8498-5814868636e7" status: 200 len: 1499 microversion: 2.1 time: 0.166739 May 25 16:28:04.884576 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 425/858] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:04 2022] GET /compute/v2.1/servers/5c8f4ac3-2425-4805-8498-5814868636e7 => generated 1499 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:28:05.294199 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-ef5a0d76-51e7-4ccc-881c-b0db0a634c79 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:05.294768 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-ef5a0d76-51e7-4ccc-881c-b0db0a634c79 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 5c8f4ac3-2425-4805-8498-5814868636e7] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:05.300877 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ef5a0d76-51e7-4ccc-881c-b0db0a634c79 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:05.301325 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ef5a0d76-51e7-4ccc-881c-b0db0a634c79 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:05.302117 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ef5a0d76-51e7-4ccc-881c-b0db0a634c79 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:05.302543 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ef5a0d76-51e7-4ccc-881c-b0db0a634c79 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:05.330546 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-ef5a0d76-51e7-4ccc-881c-b0db0a634c79 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 5c8f4ac3-2425-4805-8498-5814868636e7] Going to try to terminate instance {{(pid=117509) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:28:05.418368 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-ef5a0d76-51e7-4ccc-881c-b0db0a634c79 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5c8f4ac3-2425-4805-8498-5814868636e7" status: 204 len: 0 microversion: 2.1 time: 0.128665 May 25 16:28:05.422269 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 434/859] 10.222.0.42 () {58 vars in 1238 bytes} [Wed May 25 16:28:05 2022] DELETE /compute/v2.1/servers/5c8f4ac3-2425-4805-8498-5814868636e7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:28:05.427720 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-83a93050-0111-431d-a8cb-35d24a3e03a8 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:05.428560 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-83a93050-0111-431d-a8cb-35d24a3e03a8 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 5c8f4ac3-2425-4805-8498-5814868636e7] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:05.436099 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-83a93050-0111-431d-a8cb-35d24a3e03a8 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:05.436548 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-83a93050-0111-431d-a8cb-35d24a3e03a8 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:05.437910 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-83a93050-0111-431d-a8cb-35d24a3e03a8 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:05.438016 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-83a93050-0111-431d-a8cb-35d24a3e03a8 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:05.611715 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-83a93050-0111-431d-a8cb-35d24a3e03a8 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36eda4f44b9428d9ff648979059fb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe1de3697c04df4865c4a145a524231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:05.619222 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-83a93050-0111-431d-a8cb-35d24a3e03a8 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "GET /compute/v2.1/servers/5c8f4ac3-2425-4805-8498-5814868636e7" status: 200 len: 1505 microversion: 2.1 time: 0.195493 May 25 16:28:05.619884 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 426/860] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:05 2022] GET /compute/v2.1/servers/5c8f4ac3-2425-4805-8498-5814868636e7 => generated 1505 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:28:05.745512 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-753b0ccb-8b1f-43be-a741-7f1cfdeceda1 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:05.746486 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-753b0ccb-8b1f-43be-a741-7f1cfdeceda1 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: be25cf4d-733b-4999-b6d9-474da04a6444] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:05.752674 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-753b0ccb-8b1f-43be-a741-7f1cfdeceda1 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:05.753116 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-753b0ccb-8b1f-43be-a741-7f1cfdeceda1 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:05.753918 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-753b0ccb-8b1f-43be-a741-7f1cfdeceda1 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:05.754351 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-753b0ccb-8b1f-43be-a741-7f1cfdeceda1 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:05.910697 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-753b0ccb-8b1f-43be-a741-7f1cfdeceda1 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:05.918669 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-753b0ccb-8b1f-43be-a741-7f1cfdeceda1 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444" status: 200 len: 1265 microversion: 2.1 time: 0.177949 May 25 16:28:05.919241 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 435/861] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:05 2022] GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:28:06.636774 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-adab21a9-303f-4ee8-8364-f4e9d0086c9c tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:06.637384 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-adab21a9-303f-4ee8-8364-f4e9d0086c9c tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 5c8f4ac3-2425-4805-8498-5814868636e7] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:06.639789 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell0:SELECT=2 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:28:06.640552 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell0:SELECT=10 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:28:06.646087 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-adab21a9-303f-4ee8-8364-f4e9d0086c9c tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:06.646801 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-adab21a9-303f-4ee8-8364-f4e9d0086c9c tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:06.647504 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-adab21a9-303f-4ee8-8364-f4e9d0086c9c tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:06.647939 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-adab21a9-303f-4ee8-8364-f4e9d0086c9c tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:06.806562 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-adab21a9-303f-4ee8-8364-f4e9d0086c9c tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36eda4f44b9428d9ff648979059fb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe1de3697c04df4865c4a145a524231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:06.817683 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-adab21a9-303f-4ee8-8364-f4e9d0086c9c tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "GET /compute/v2.1/servers/5c8f4ac3-2425-4805-8498-5814868636e7" status: 200 len: 1505 microversion: 2.1 time: 0.184697 May 25 16:28:06.828536 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 427/862] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:06 2022] GET /compute/v2.1/servers/5c8f4ac3-2425-4805-8498-5814868636e7 => generated 1505 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:28:06.940933 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-44fd2976-4a81-4209-af37-6983453fdedb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:06.942163 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-44fd2976-4a81-4209-af37-6983453fdedb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: be25cf4d-733b-4999-b6d9-474da04a6444] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:06.950663 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-44fd2976-4a81-4209-af37-6983453fdedb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:06.951465 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-44fd2976-4a81-4209-af37-6983453fdedb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:06.952621 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-44fd2976-4a81-4209-af37-6983453fdedb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:06.953676 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-44fd2976-4a81-4209-af37-6983453fdedb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:07.112678 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-44fd2976-4a81-4209-af37-6983453fdedb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:07.120104 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-44fd2976-4a81-4209-af37-6983453fdedb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444" status: 200 len: 1265 microversion: 2.1 time: 0.188254 May 25 16:28:07.120848 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 436/863] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:06 2022] GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:28:07.832924 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-39d5e57b-d357-4e41-9d89-9c22860f5782 req-24a10a5d-c6d3-4a60-98fa-f0f9c6f03e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c8f4ac3-2425-4805-8498-5814868636e7", "name": "network-vif-deleted", "tag": "e355d9a6-ffa7-4027-a9ca-7fc0db0b35b9"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:28:07.843352 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-39d5e57b-d357-4e41-9d89-9c22860f5782 req-24a10a5d-c6d3-4a60-98fa-f0f9c6f03e6f service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:07.843793 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-39d5e57b-d357-4e41-9d89-9c22860f5782 req-24a10a5d-c6d3-4a60-98fa-f0f9c6f03e6f service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:07.844742 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-b987c0ac-976e-45ab-86ac-d52e00828f3a tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:07.846362 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-b987c0ac-976e-45ab-86ac-d52e00828f3a tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 5c8f4ac3-2425-4805-8498-5814868636e7] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:07.858106 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b987c0ac-976e-45ab-86ac-d52e00828f3a tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:07.858866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b987c0ac-976e-45ab-86ac-d52e00828f3a tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:07.859844 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b987c0ac-976e-45ab-86ac-d52e00828f3a tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:07.860572 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b987c0ac-976e-45ab-86ac-d52e00828f3a tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:07.870890 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-39d5e57b-d357-4e41-9d89-9c22860f5782 req-24a10a5d-c6d3-4a60-98fa-f0f9c6f03e6f service nova] Creating event network-vif-deleted:e355d9a6-ffa7-4027-a9ca-7fc0db0b35b9 for instance 5c8f4ac3-2425-4805-8498-5814868636e7 on hv-cinder-84327 May 25 16:28:07.882843 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-39d5e57b-d357-4e41-9d89-9c22860f5782 req-24a10a5d-c6d3-4a60-98fa-f0f9c6f03e6f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052170 May 25 16:28:07.882843 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 428/864] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:28:07.941128 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-b987c0ac-976e-45ab-86ac-d52e00828f3a tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36eda4f44b9428d9ff648979059fb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe1de3697c04df4865c4a145a524231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:07.951010 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-b987c0ac-976e-45ab-86ac-d52e00828f3a tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "GET /compute/v2.1/servers/5c8f4ac3-2425-4805-8498-5814868636e7" status: 200 len: 1463 microversion: 2.1 time: 0.113025 May 25 16:28:07.951585 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 437/865] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:07 2022] GET /compute/v2.1/servers/5c8f4ac3-2425-4805-8498-5814868636e7 => generated 1463 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:28:08.137940 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-0152525b-b361-4133-890f-108d34cad1b7 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:08.138620 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-0152525b-b361-4133-890f-108d34cad1b7 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: be25cf4d-733b-4999-b6d9-474da04a6444] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:08.151570 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0152525b-b361-4133-890f-108d34cad1b7 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:08.152191 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0152525b-b361-4133-890f-108d34cad1b7 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:08.153088 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0152525b-b361-4133-890f-108d34cad1b7 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:08.153599 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0152525b-b361-4133-890f-108d34cad1b7 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:08.303125 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-0152525b-b361-4133-890f-108d34cad1b7 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:08.311209 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-0152525b-b361-4133-890f-108d34cad1b7 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444" status: 200 len: 1265 microversion: 2.1 time: 0.177783 May 25 16:28:08.320470 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 429/866] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:08 2022] GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:28:08.968579 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-f974ca16-0c28-4368-bdd1-e3dc6f24b8e4 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:08.969187 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-f974ca16-0c28-4368-bdd1-e3dc6f24b8e4 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 5c8f4ac3-2425-4805-8498-5814868636e7] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:08.976071 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f974ca16-0c28-4368-bdd1-e3dc6f24b8e4 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:08.976547 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f974ca16-0c28-4368-bdd1-e3dc6f24b8e4 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:08.977428 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f974ca16-0c28-4368-bdd1-e3dc6f24b8e4 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:08.977896 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f974ca16-0c28-4368-bdd1-e3dc6f24b8e4 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:08.993126 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.wsgi [None req-f974ca16-0c28-4368-bdd1-e3dc6f24b8e4 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] HTTP exception thrown: Instance 5c8f4ac3-2425-4805-8498-5814868636e7 could not be found. May 25 16:28:08.995500 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-f974ca16-0c28-4368-bdd1-e3dc6f24b8e4 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Request method failure captured: May 25 16:28:08.995500 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: GET /compute/v2.1/servers/5c8f4ac3-2425-4805-8498-5814868636e7 HTTP/1.1 May 25 16:28:08.995500 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:28:08.995500 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:28:08.995500 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:28:08.995500 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 0 May 25 16:28:08.995500 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:28:08.995500 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:28:08.995500 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:28:08.995500 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:28:08.995500 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijlkHGQNB2LE_VPMufDuH-3RHz54tKH5yGAHe84J3JX06PbTjpiRu64NUH6UUdYjIuErL_uVvCwyMCyrTq6N3Sokklv9lK2lnDqZdEDvRQ3k3V8dkLoZRIEgUsmWcgTcOjH5AhAyW-H9MBRATG7-zLv4rq2ignEv1TxCO4i9uIOJ2fgg May 25 16:28:08.995500 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:28:08.995500 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:28:08.995500 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:28:08.995500 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:28:08.995500 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:28:08.995500 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:28:08.995500 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: 1fe1de3697c04df4865c4a145a524231 May 25 16:28:08.995500 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-VolumesActionsTest-408508027 May 25 16:28:08.995500 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:28:08.995500 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:28:08.997412 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1fe1de3697c04df4865c4a145a524231"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1fe1de3697c04df4865c4a145a524231"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1fe1de3697c04df4865c4a145a524231"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1fe1de3697c04df4865c4a145a524231"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:28:08.997412 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-VolumesActionsTest-408508027 May 25 16:28:08.997412 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: 1fe1de3697c04df4865c4a145a524231 May 25 16:28:08.997412 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-VolumesActionsTest-408508027 May 25 16:28:08.997412 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-VolumesActionsTest-408508027-project May 25 16:28:08.997412 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:28:08.997412 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:28:08.997412 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: b36eda4f44b9428d9ff648979059fb5b May 25 16:28:08.997412 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-VolumesActionsTest-408508027-project May 25 16:28:08.997412 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: > May 25 16:28:08.997412 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Instance 5c8f4ac3-2425-4805-8498-5814868636e7 could not be found. May 25 16:28:08.997412 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'id': '5c8f4ac3-2425-4805-8498-5814868636e7'} May 25 16:28:08.998377 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:28:08.998377 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:28:08.998377 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:28:08.998377 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:28:08.998377 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:28:08.998377 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:28:08.998377 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:28:08.998377 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:28:08.998377 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:28:08.998377 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:28:08.998377 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c8f4ac3-2425-4805-8498-5814868636e7 could not be found. May 25 16:28:08.998377 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:28:08.998377 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:28:08.998377 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:28:08.998377 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:28:08.998377 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:28:08.998377 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:28:08.998377 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:28:08.998377 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:28:08.998377 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:28:09.000099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:28:09.000099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:28:09.000099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:28:09.000099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:28:09.000099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:28:09.000099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:28:09.000099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:28:09.000099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c8f4ac3-2425-4805-8498-5814868636e7 could not be found. May 25 16:28:09.000099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:28:09.000099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:28:09.000099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:28:09.000099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:28:09.000099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:28:09.000099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:28:09.000099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:28:09.000099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:28:09.000099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c8f4ac3-2425-4805-8498-5814868636e7 could not be found. May 25 16:28:09.000099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:28:09.001547 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-f974ca16-0c28-4368-bdd1-e3dc6f24b8e4 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Returning 404 to user: Instance 5c8f4ac3-2425-4805-8498-5814868636e7 could not be found. {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:28:09.001547 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-f974ca16-0c28-4368-bdd1-e3dc6f24b8e4 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "GET /compute/v2.1/servers/5c8f4ac3-2425-4805-8498-5814868636e7" status: 404 len: 111 microversion: 2.1 time: 0.032249 May 25 16:28:09.009023 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 438/867] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:08 2022] GET /compute/v2.1/servers/5c8f4ac3-2425-4805-8498-5814868636e7 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:28:09.110819 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-ded87453-358f-4eee-940b-812f7629c2a7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-982191135", "imageRef": "e74cccc1-cd1b-4dfc-8e47-3e4a832649a8", "flavorRef": "452", "networks": [{"uuid": "6baa21b1-34f5-4c8e-82eb-998cf516fa1e"}]}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:28:09.167226 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.network.neutron [None req-ded87453-358f-4eee-940b-812f7629c2a7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] validate_networks() for [('6baa21b1-34f5-4c8e-82eb-998cf516fa1e', None, None, None, None, None)] {{(pid=117510) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:28:09.328127 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-009c6b4c-a6f4-4f13-9a78-3fc392b5025d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:09.329084 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-009c6b4c-a6f4-4f13-9a78-3fc392b5025d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: be25cf4d-733b-4999-b6d9-474da04a6444] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:09.335571 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-009c6b4c-a6f4-4f13-9a78-3fc392b5025d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:09.336019 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-009c6b4c-a6f4-4f13-9a78-3fc392b5025d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:09.336794 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-009c6b4c-a6f4-4f13-9a78-3fc392b5025d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:09.337231 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-009c6b4c-a6f4-4f13-9a78-3fc392b5025d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:09.356635 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:28:09.557826 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-009c6b4c-a6f4-4f13-9a78-3fc392b5025d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:09.565224 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-009c6b4c-a6f4-4f13-9a78-3fc392b5025d tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444" status: 200 len: 1265 microversion: 2.1 time: 0.240975 May 25 16:28:09.565914 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 439/868] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:09 2022] GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:28:09.591422 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-ded87453-358f-4eee-940b-812f7629c2a7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Flavor limits 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:28:09.591849 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-ded87453-358f-4eee-940b-812f7629c2a7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Image limits 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:28:09.592356 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-ded87453-358f-4eee-940b-812f7629c2a7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Flavor pref 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:28:09.592766 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-ded87453-358f-4eee-940b-812f7629c2a7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Image pref 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:28:09.593182 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-ded87453-358f-4eee-940b-812f7629c2a7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:28:09.602061 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ded87453-358f-4eee-940b-812f7629c2a7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:09.602512 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ded87453-358f-4eee-940b-812f7629c2a7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:09.603969 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ded87453-358f-4eee-940b-812f7629c2a7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:09.604411 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ded87453-358f-4eee-940b-812f7629c2a7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:09.620981 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-ded87453-358f-4eee-940b-812f7629c2a7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Getting quotas for project 1fe1de3697c04df4865c4a145a524231. Resources: {'ram', 'cores', 'instances'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:28:09.624905 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-ded87453-358f-4eee-940b-812f7629c2a7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Getting quotas for user b36eda4f44b9428d9ff648979059fb5b and project 1fe1de3697c04df4865c4a145a524231. Resources: {'ram', 'cores', 'instances'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:28:09.636534 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-ded87453-358f-4eee-940b-812f7629c2a7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Going to run 1 instances... {{(pid=117510) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:28:09.638838 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-ded87453-358f-4eee-940b-812f7629c2a7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 6349f6ac-f05d-4eb0-902d-d70acad20a64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e74cccc1-cd1b-4dfc-8e47-3e4a832649a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:28:09.686114 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-ded87453-358f-4eee-940b-812f7629c2a7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578803 May 25 16:28:09.686690 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 430/869] 10.222.0.42 () {60 vars in 1146 bytes} [Wed May 25 16:28:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:28:09.697152 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-798f443b-d045-408d-922c-2db171218a06 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:09.698258 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-798f443b-d045-408d-922c-2db171218a06 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 6349f6ac-f05d-4eb0-902d-d70acad20a64] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:09.755257 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-798f443b-d045-408d-922c-2db171218a06 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36eda4f44b9428d9ff648979059fb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe1de3697c04df4865c4a145a524231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:09.765166 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-798f443b-d045-408d-922c-2db171218a06 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64" status: 200 len: 1213 microversion: 2.1 time: 0.070074 May 25 16:28:09.771026 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 440/870] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:09 2022] GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64 => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:28:10.582734 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-47306e7a-c7d2-4e85-b989-c913738cefaa tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:10.583343 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-47306e7a-c7d2-4e85-b989-c913738cefaa tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: be25cf4d-733b-4999-b6d9-474da04a6444] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:10.590694 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-47306e7a-c7d2-4e85-b989-c913738cefaa tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:10.591169 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-47306e7a-c7d2-4e85-b989-c913738cefaa tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:10.591930 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-47306e7a-c7d2-4e85-b989-c913738cefaa tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:10.592366 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-47306e7a-c7d2-4e85-b989-c913738cefaa tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:10.723799 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-47306e7a-c7d2-4e85-b989-c913738cefaa tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:10.731433 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-47306e7a-c7d2-4e85-b989-c913738cefaa tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444" status: 200 len: 1265 microversion: 2.1 time: 0.153100 May 25 16:28:10.731987 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 431/871] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:10 2022] GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:28:10.780199 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-b40bc416-27e4-42ef-80f6-8ce3aab724e5 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:10.780799 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-b40bc416-27e4-42ef-80f6-8ce3aab724e5 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 6349f6ac-f05d-4eb0-902d-d70acad20a64] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:10.788056 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b40bc416-27e4-42ef-80f6-8ce3aab724e5 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:10.788501 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b40bc416-27e4-42ef-80f6-8ce3aab724e5 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:10.789288 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b40bc416-27e4-42ef-80f6-8ce3aab724e5 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:10.789741 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b40bc416-27e4-42ef-80f6-8ce3aab724e5 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:10.848836 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-b40bc416-27e4-42ef-80f6-8ce3aab724e5 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36eda4f44b9428d9ff648979059fb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe1de3697c04df4865c4a145a524231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:10.856093 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-b40bc416-27e4-42ef-80f6-8ce3aab724e5 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64" status: 200 len: 1217 microversion: 2.1 time: 0.079692 May 25 16:28:10.856650 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 441/872] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:10 2022] GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64 => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:28:11.748312 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-9311cc52-f09e-4e58-bdc9-5b337feee6c4 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:11.748842 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-9311cc52-f09e-4e58-bdc9-5b337feee6c4 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: be25cf4d-733b-4999-b6d9-474da04a6444] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:11.755288 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9311cc52-f09e-4e58-bdc9-5b337feee6c4 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:11.755736 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9311cc52-f09e-4e58-bdc9-5b337feee6c4 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:11.756498 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9311cc52-f09e-4e58-bdc9-5b337feee6c4 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:11.756931 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9311cc52-f09e-4e58-bdc9-5b337feee6c4 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:11.873357 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-7662a661-24b8-48c0-908c-72f3d0156365 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:11.874076 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-7662a661-24b8-48c0-908c-72f3d0156365 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 6349f6ac-f05d-4eb0-902d-d70acad20a64] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:11.881694 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7662a661-24b8-48c0-908c-72f3d0156365 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:11.882341 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7662a661-24b8-48c0-908c-72f3d0156365 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:11.883269 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7662a661-24b8-48c0-908c-72f3d0156365 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:11.883854 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7662a661-24b8-48c0-908c-72f3d0156365 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:11.888031 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-9311cc52-f09e-4e58-bdc9-5b337feee6c4 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:11.895707 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-9311cc52-f09e-4e58-bdc9-5b337feee6c4 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444" status: 200 len: 1265 microversion: 2.1 time: 0.151350 May 25 16:28:11.896485 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 432/873] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:11 2022] GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:28:11.954429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-7662a661-24b8-48c0-908c-72f3d0156365 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36eda4f44b9428d9ff648979059fb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe1de3697c04df4865c4a145a524231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:11.962299 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-7662a661-24b8-48c0-908c-72f3d0156365 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64" status: 200 len: 1209 microversion: 2.1 time: 0.092863 May 25 16:28:11.963838 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 442/874] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:11 2022] GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64 => generated 1209 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:28:12.461215 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-1980c3da-53ac-4ff1-927a-4f9f0a00d809 req-a52f46dc-9865-4b78-b4a5-536a4e2fe113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be25cf4d-733b-4999-b6d9-474da04a6444", "name": "network-vif-plugged", "status": "completed", "tag": "28e24d33-7178-4533-933f-ce0069b847bd"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:28:12.471722 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-1980c3da-53ac-4ff1-927a-4f9f0a00d809 req-a52f46dc-9865-4b78-b4a5-536a4e2fe113 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:12.472584 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-1980c3da-53ac-4ff1-927a-4f9f0a00d809 req-a52f46dc-9865-4b78-b4a5-536a4e2fe113 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:12.485911 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-1980c3da-53ac-4ff1-927a-4f9f0a00d809 req-a52f46dc-9865-4b78-b4a5-536a4e2fe113 service nova] Creating event network-vif-plugged:28e24d33-7178-4533-933f-ce0069b847bd for instance be25cf4d-733b-4999-b6d9-474da04a6444 on hv-cinder-84327 May 25 16:28:12.492871 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-1980c3da-53ac-4ff1-927a-4f9f0a00d809 req-a52f46dc-9865-4b78-b4a5-536a4e2fe113 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034733 May 25 16:28:12.494564 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 433/875] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:28:12.913747 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-b379d0f1-3136-4a49-a85f-59ad8e014f67 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:12.914355 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-b379d0f1-3136-4a49-a85f-59ad8e014f67 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: be25cf4d-733b-4999-b6d9-474da04a6444] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:12.921789 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b379d0f1-3136-4a49-a85f-59ad8e014f67 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:12.922246 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b379d0f1-3136-4a49-a85f-59ad8e014f67 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:12.923020 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b379d0f1-3136-4a49-a85f-59ad8e014f67 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:12.923459 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b379d0f1-3136-4a49-a85f-59ad8e014f67 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:12.981102 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-f8dc93d4-771e-45e7-ba3e-b8831721892a tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:12.981837 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-f8dc93d4-771e-45e7-ba3e-b8831721892a tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 6349f6ac-f05d-4eb0-902d-d70acad20a64] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:12.988526 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f8dc93d4-771e-45e7-ba3e-b8831721892a tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:12.988972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f8dc93d4-771e-45e7-ba3e-b8831721892a tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:12.989974 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f8dc93d4-771e-45e7-ba3e-b8831721892a tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:12.990587 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f8dc93d4-771e-45e7-ba3e-b8831721892a tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:13.109534 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-b379d0f1-3136-4a49-a85f-59ad8e014f67 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:13.117064 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-b379d0f1-3136-4a49-a85f-59ad8e014f67 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444" status: 200 len: 1265 microversion: 2.1 time: 0.207367 May 25 16:28:13.117889 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 443/876] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:12 2022] GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:28:13.189692 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-f8dc93d4-771e-45e7-ba3e-b8831721892a tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36eda4f44b9428d9ff648979059fb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe1de3697c04df4865c4a145a524231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:13.198554 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-f8dc93d4-771e-45e7-ba3e-b8831721892a tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64" status: 200 len: 1313 microversion: 2.1 time: 0.221458 May 25 16:28:13.199396 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 434/877] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:12 2022] GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:28:13.939516 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-b420977a-4d11-4d6c-b3cd-210cc499d7c9 req-de4ba921-54f7-416f-a0cc-caa1436632ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6349f6ac-f05d-4eb0-902d-d70acad20a64", "tag": "1b308357-2eea-4345-8819-270bbbadb931"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:28:13.953751 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-b420977a-4d11-4d6c-b3cd-210cc499d7c9 req-de4ba921-54f7-416f-a0cc-caa1436632ce service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:13.954234 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-b420977a-4d11-4d6c-b3cd-210cc499d7c9 req-de4ba921-54f7-416f-a0cc-caa1436632ce service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:13.973453 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-b420977a-4d11-4d6c-b3cd-210cc499d7c9 req-de4ba921-54f7-416f-a0cc-caa1436632ce service nova] Creating event network-changed:1b308357-2eea-4345-8819-270bbbadb931 for instance 6349f6ac-f05d-4eb0-902d-d70acad20a64 on hv-cinder-84327 May 25 16:28:13.978274 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-b420977a-4d11-4d6c-b3cd-210cc499d7c9 req-de4ba921-54f7-416f-a0cc-caa1436632ce service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042629 May 25 16:28:13.978875 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 444/878] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:28:14.194302 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-17cbbc03-0bb3-4c91-a05d-aac5b5999e74 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:14.195178 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-17cbbc03-0bb3-4c91-a05d-aac5b5999e74 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: be25cf4d-733b-4999-b6d9-474da04a6444] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:14.202332 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-17cbbc03-0bb3-4c91-a05d-aac5b5999e74 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:14.202787 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-17cbbc03-0bb3-4c91-a05d-aac5b5999e74 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:14.203566 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-17cbbc03-0bb3-4c91-a05d-aac5b5999e74 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:14.204006 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-17cbbc03-0bb3-4c91-a05d-aac5b5999e74 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:14.216776 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-b06228a1-d189-4f52-b493-9613dce13258 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:14.217560 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-b06228a1-d189-4f52-b493-9613dce13258 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 6349f6ac-f05d-4eb0-902d-d70acad20a64] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:14.224152 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b06228a1-d189-4f52-b493-9613dce13258 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:14.224595 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b06228a1-d189-4f52-b493-9613dce13258 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:14.225367 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b06228a1-d189-4f52-b493-9613dce13258 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:14.225828 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b06228a1-d189-4f52-b493-9613dce13258 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:14.449200 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-17cbbc03-0bb3-4c91-a05d-aac5b5999e74 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:14.451213 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-b06228a1-d189-4f52-b493-9613dce13258 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36eda4f44b9428d9ff648979059fb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe1de3697c04df4865c4a145a524231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:14.457997 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-17cbbc03-0bb3-4c91-a05d-aac5b5999e74 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444" status: 200 len: 1265 microversion: 2.1 time: 0.267545 May 25 16:28:14.458742 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 435/879] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:14 2022] GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444 => generated 1265 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:28:14.468411 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-b06228a1-d189-4f52-b493-9613dce13258 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64" status: 200 len: 1313 microversion: 2.1 time: 0.256484 May 25 16:28:14.469034 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 445/880] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:14 2022] GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:28:15.474629 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-a52ed251-16b5-4502-9d6a-1ef5a2d2963e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:15.475254 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-a52ed251-16b5-4502-9d6a-1ef5a2d2963e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: be25cf4d-733b-4999-b6d9-474da04a6444] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:15.482815 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a52ed251-16b5-4502-9d6a-1ef5a2d2963e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:15.483386 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a52ed251-16b5-4502-9d6a-1ef5a2d2963e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:15.484265 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a52ed251-16b5-4502-9d6a-1ef5a2d2963e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:15.484785 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a52ed251-16b5-4502-9d6a-1ef5a2d2963e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:15.485234 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-854ea5fc-273a-4493-a322-a60324f25934 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:15.485872 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-854ea5fc-273a-4493-a322-a60324f25934 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 6349f6ac-f05d-4eb0-902d-d70acad20a64] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:15.492474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-854ea5fc-273a-4493-a322-a60324f25934 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:15.498214 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-854ea5fc-273a-4493-a322-a60324f25934 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:15.499261 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-854ea5fc-273a-4493-a322-a60324f25934 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:15.500344 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-854ea5fc-273a-4493-a322-a60324f25934 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:15.700482 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-a52ed251-16b5-4502-9d6a-1ef5a2d2963e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:15.703993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=100 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:28:15.707380 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-854ea5fc-273a-4493-a322-a60324f25934 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36eda4f44b9428d9ff648979059fb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe1de3697c04df4865c4a145a524231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:15.715349 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-854ea5fc-273a-4493-a322-a60324f25934 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64" status: 200 len: 1313 microversion: 2.1 time: 0.233819 May 25 16:28:15.715918 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 446/881] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:15 2022] GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:28:15.716430 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-a52ed251-16b5-4502-9d6a-1ef5a2d2963e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444" status: 200 len: 1451 microversion: 2.1 time: 0.245930 May 25 16:28:15.717084 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 436/882] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:15 2022] GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444 => generated 1451 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:28:15.732882 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-f023a269-afc2-4c3a-81de-81cfd4dfa291 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:15.733489 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-f023a269-afc2-4c3a-81de-81cfd4dfa291 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: be25cf4d-733b-4999-b6d9-474da04a6444] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:15.739356 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f023a269-afc2-4c3a-81de-81cfd4dfa291 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:15.739808 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f023a269-afc2-4c3a-81de-81cfd4dfa291 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:15.740624 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f023a269-afc2-4c3a-81de-81cfd4dfa291 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:15.741094 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f023a269-afc2-4c3a-81de-81cfd4dfa291 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:15.886775 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-f023a269-afc2-4c3a-81de-81cfd4dfa291 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:15.896279 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-f023a269-afc2-4c3a-81de-81cfd4dfa291 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444" status: 200 len: 1451 microversion: 2.1 time: 0.167611 May 25 16:28:15.896866 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 447/883] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:15 2022] GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444 => generated 1451 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:28:16.735671 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-930022c3-d363-46dd-a613-2fe9224f6c78 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:16.737460 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-930022c3-d363-46dd-a613-2fe9224f6c78 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 6349f6ac-f05d-4eb0-902d-d70acad20a64] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:16.746950 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-930022c3-d363-46dd-a613-2fe9224f6c78 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:16.747651 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-930022c3-d363-46dd-a613-2fe9224f6c78 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:16.748618 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-930022c3-d363-46dd-a613-2fe9224f6c78 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:16.749215 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-930022c3-d363-46dd-a613-2fe9224f6c78 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:16.996780 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-930022c3-d363-46dd-a613-2fe9224f6c78 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36eda4f44b9428d9ff648979059fb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe1de3697c04df4865c4a145a524231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:17.004716 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-930022c3-d363-46dd-a613-2fe9224f6c78 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64" status: 200 len: 1313 microversion: 2.1 time: 0.276306 May 25 16:28:17.015034 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 437/884] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:16 2022] GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64 => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:28:18.021759 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-b18b4ffa-d87a-484a-a4ea-90c852667cb6 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:18.022447 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-b18b4ffa-d87a-484a-a4ea-90c852667cb6 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 6349f6ac-f05d-4eb0-902d-d70acad20a64] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:18.032149 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b18b4ffa-d87a-484a-a4ea-90c852667cb6 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:18.032563 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-f4bc4e27-5738-4956-b14d-f3748adb72ed req-834ca88e-2eee-4f5c-926b-c649d2cd8954 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be25cf4d-733b-4999-b6d9-474da04a6444", "tag": "28e24d33-7178-4533-933f-ce0069b847bd"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:28:18.035280 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b18b4ffa-d87a-484a-a4ea-90c852667cb6 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:18.038037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b18b4ffa-d87a-484a-a4ea-90c852667cb6 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:18.039549 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b18b4ffa-d87a-484a-a4ea-90c852667cb6 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:18.043296 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-f4bc4e27-5738-4956-b14d-f3748adb72ed req-834ca88e-2eee-4f5c-926b-c649d2cd8954 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:18.043949 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-f4bc4e27-5738-4956-b14d-f3748adb72ed req-834ca88e-2eee-4f5c-926b-c649d2cd8954 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:18.056149 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-f4bc4e27-5738-4956-b14d-f3748adb72ed req-834ca88e-2eee-4f5c-926b-c649d2cd8954 service nova] Creating event network-changed:28e24d33-7178-4533-933f-ce0069b847bd for instance be25cf4d-733b-4999-b6d9-474da04a6444 on hv-cinder-84327 May 25 16:28:18.077264 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-f4bc4e27-5738-4956-b14d-f3748adb72ed req-834ca88e-2eee-4f5c-926b-c649d2cd8954 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048976 May 25 16:28:18.078156 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 438/885] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:28:18.339781 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-b18b4ffa-d87a-484a-a4ea-90c852667cb6 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36eda4f44b9428d9ff648979059fb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe1de3697c04df4865c4a145a524231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:18.348935 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-b18b4ffa-d87a-484a-a4ea-90c852667cb6 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64" status: 200 len: 1313 microversion: 2.1 time: 0.331352 May 25 16:28:18.351635 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 448/886] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:18 2022] GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64 => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:28:18.727472 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-51c25756-224b-4b14-927f-a57d47a7fa7a req-c7d0eef7-cd5b-4f16-9d4e-f3460c76b4e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6349f6ac-f05d-4eb0-902d-d70acad20a64", "name": "network-vif-plugged", "status": "completed", "tag": "1b308357-2eea-4345-8819-270bbbadb931"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:28:18.737391 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-51c25756-224b-4b14-927f-a57d47a7fa7a req-c7d0eef7-cd5b-4f16-9d4e-f3460c76b4e1 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:18.738955 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-51c25756-224b-4b14-927f-a57d47a7fa7a req-c7d0eef7-cd5b-4f16-9d4e-f3460c76b4e1 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:18.752939 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-51c25756-224b-4b14-927f-a57d47a7fa7a req-c7d0eef7-cd5b-4f16-9d4e-f3460c76b4e1 service nova] Creating event network-vif-plugged:1b308357-2eea-4345-8819-270bbbadb931 for instance 6349f6ac-f05d-4eb0-902d-d70acad20a64 on hv-cinder-84327 May 25 16:28:18.758195 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-51c25756-224b-4b14-927f-a57d47a7fa7a req-c7d0eef7-cd5b-4f16-9d4e-f3460c76b4e1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034906 May 25 16:28:18.758860 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 439/887] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:28:19.369456 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-5123b9f1-cece-4786-adf0-e298e8dbdce1 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:19.375905 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-5123b9f1-cece-4786-adf0-e298e8dbdce1 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 6349f6ac-f05d-4eb0-902d-d70acad20a64] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:19.382653 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5123b9f1-cece-4786-adf0-e298e8dbdce1 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:19.383105 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5123b9f1-cece-4786-adf0-e298e8dbdce1 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:19.383882 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5123b9f1-cece-4786-adf0-e298e8dbdce1 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:19.384940 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5123b9f1-cece-4786-adf0-e298e8dbdce1 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:19.525257 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-5123b9f1-cece-4786-adf0-e298e8dbdce1 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36eda4f44b9428d9ff648979059fb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe1de3697c04df4865c4a145a524231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:19.534529 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-5123b9f1-cece-4786-adf0-e298e8dbdce1 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64" status: 200 len: 1313 microversion: 2.1 time: 0.169902 May 25 16:28:19.535162 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 449/888] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:19 2022] GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:28:20.553115 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-f1e6cf65-5f22-4364-ac03-4ce147734e3b tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:20.553839 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-f1e6cf65-5f22-4364-ac03-4ce147734e3b tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 6349f6ac-f05d-4eb0-902d-d70acad20a64] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:20.556728 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell0:SELECT=2 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:28:20.557420 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell0:SELECT=6 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:28:20.564310 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f1e6cf65-5f22-4364-ac03-4ce147734e3b tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:20.564698 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f1e6cf65-5f22-4364-ac03-4ce147734e3b tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:20.565449 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f1e6cf65-5f22-4364-ac03-4ce147734e3b tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:20.565910 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f1e6cf65-5f22-4364-ac03-4ce147734e3b tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:20.696297 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-f1e6cf65-5f22-4364-ac03-4ce147734e3b tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36eda4f44b9428d9ff648979059fb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe1de3697c04df4865c4a145a524231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:20.704314 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-f1e6cf65-5f22-4364-ac03-4ce147734e3b tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64" status: 200 len: 1313 microversion: 2.1 time: 0.155635 May 25 16:28:20.704876 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 440/889] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:20 2022] GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:28:21.721406 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-8a6a354c-0f1f-4ae3-8312-0b940fd173f7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:21.722291 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-8a6a354c-0f1f-4ae3-8312-0b940fd173f7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 6349f6ac-f05d-4eb0-902d-d70acad20a64] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:21.724287 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell0:SELECT=2 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:28:21.730947 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8a6a354c-0f1f-4ae3-8312-0b940fd173f7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:21.731506 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8a6a354c-0f1f-4ae3-8312-0b940fd173f7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:21.732377 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8a6a354c-0f1f-4ae3-8312-0b940fd173f7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:21.732873 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8a6a354c-0f1f-4ae3-8312-0b940fd173f7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:21.876635 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-8a6a354c-0f1f-4ae3-8312-0b940fd173f7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36eda4f44b9428d9ff648979059fb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe1de3697c04df4865c4a145a524231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:21.885560 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-8a6a354c-0f1f-4ae3-8312-0b940fd173f7 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64" status: 200 len: 1313 microversion: 2.1 time: 0.167876 May 25 16:28:21.886379 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 450/890] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:21 2022] GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:28:22.904297 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-95fafe4c-f0c5-4217-a627-ae91f350a3f1 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:22.905010 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-95fafe4c-f0c5-4217-a627-ae91f350a3f1 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 6349f6ac-f05d-4eb0-902d-d70acad20a64] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:22.912260 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-95fafe4c-f0c5-4217-a627-ae91f350a3f1 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:22.912792 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-95fafe4c-f0c5-4217-a627-ae91f350a3f1 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:22.913656 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-95fafe4c-f0c5-4217-a627-ae91f350a3f1 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:22.914210 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-95fafe4c-f0c5-4217-a627-ae91f350a3f1 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:23.056415 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-95fafe4c-f0c5-4217-a627-ae91f350a3f1 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36eda4f44b9428d9ff648979059fb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe1de3697c04df4865c4a145a524231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:23.063840 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-95fafe4c-f0c5-4217-a627-ae91f350a3f1 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64" status: 200 len: 1313 microversion: 2.1 time: 0.164351 May 25 16:28:23.064473 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 441/891] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:22 2022] GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:28:24.080901 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-9f9b94c1-9824-4a70-aed7-61d31187931e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:24.081575 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-9f9b94c1-9824-4a70-aed7-61d31187931e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 6349f6ac-f05d-4eb0-902d-d70acad20a64] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:24.084351 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:28:24.091540 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9f9b94c1-9824-4a70-aed7-61d31187931e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:24.091995 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9f9b94c1-9824-4a70-aed7-61d31187931e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:24.092775 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9f9b94c1-9824-4a70-aed7-61d31187931e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:24.093210 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9f9b94c1-9824-4a70-aed7-61d31187931e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:24.229468 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-9f9b94c1-9824-4a70-aed7-61d31187931e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36eda4f44b9428d9ff648979059fb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe1de3697c04df4865c4a145a524231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:24.240902 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-9f9b94c1-9824-4a70-aed7-61d31187931e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64" status: 200 len: 1498 microversion: 2.1 time: 0.163816 May 25 16:28:24.241556 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 451/892] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:24 2022] GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64 => generated 1498 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:28:24.738345 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-273e4828-c98e-40b0-a0f1-00cf4acb7469 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:24.738902 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-273e4828-c98e-40b0-a0f1-00cf4acb7469 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 6349f6ac-f05d-4eb0-902d-d70acad20a64] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:24.743137 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:28:24.747701 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-273e4828-c98e-40b0-a0f1-00cf4acb7469 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:24.748146 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-273e4828-c98e-40b0-a0f1-00cf4acb7469 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:24.748953 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-273e4828-c98e-40b0-a0f1-00cf4acb7469 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:24.749424 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-273e4828-c98e-40b0-a0f1-00cf4acb7469 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:24.778515 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-273e4828-c98e-40b0-a0f1-00cf4acb7469 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 6349f6ac-f05d-4eb0-902d-d70acad20a64] Going to try to terminate instance {{(pid=117510) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:28:24.868941 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-273e4828-c98e-40b0-a0f1-00cf4acb7469 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64" status: 204 len: 0 microversion: 2.1 time: 0.133737 May 25 16:28:24.870249 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 442/893] 10.222.0.42 () {58 vars in 1238 bytes} [Wed May 25 16:28:24 2022] DELETE /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:28:24.881174 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-b444eb45-0eb3-4993-a354-3743fa77a60e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:24.881904 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-b444eb45-0eb3-4993-a354-3743fa77a60e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 6349f6ac-f05d-4eb0-902d-d70acad20a64] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:24.888865 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b444eb45-0eb3-4993-a354-3743fa77a60e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:24.889402 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b444eb45-0eb3-4993-a354-3743fa77a60e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:24.890249 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b444eb45-0eb3-4993-a354-3743fa77a60e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:24.890687 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b444eb45-0eb3-4993-a354-3743fa77a60e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:25.045617 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-b444eb45-0eb3-4993-a354-3743fa77a60e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36eda4f44b9428d9ff648979059fb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe1de3697c04df4865c4a145a524231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:25.054242 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-b444eb45-0eb3-4993-a354-3743fa77a60e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64" status: 200 len: 1504 microversion: 2.1 time: 0.179461 May 25 16:28:25.054819 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 452/894] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:24 2022] GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64 => generated 1504 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:28:26.073456 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-d8d3b494-d2a5-4d5e-bcfa-85abd218d041 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:26.074195 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-d8d3b494-d2a5-4d5e-bcfa-85abd218d041 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 6349f6ac-f05d-4eb0-902d-d70acad20a64] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:26.083786 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d8d3b494-d2a5-4d5e-bcfa-85abd218d041 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:26.084244 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d8d3b494-d2a5-4d5e-bcfa-85abd218d041 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:26.085036 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d8d3b494-d2a5-4d5e-bcfa-85abd218d041 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:26.085556 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d8d3b494-d2a5-4d5e-bcfa-85abd218d041 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:26.235410 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-d8d3b494-d2a5-4d5e-bcfa-85abd218d041 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36eda4f44b9428d9ff648979059fb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe1de3697c04df4865c4a145a524231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:26.243852 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-d8d3b494-d2a5-4d5e-bcfa-85abd218d041 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64" status: 200 len: 1504 microversion: 2.1 time: 0.174538 May 25 16:28:26.244509 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 443/895] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:26 2022] GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64 => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:28:27.265150 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-a819c9d5-deb6-4257-8432-a1ed2a2ecc3e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:27.267227 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-a819c9d5-deb6-4257-8432-a1ed2a2ecc3e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 6349f6ac-f05d-4eb0-902d-d70acad20a64] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:27.281530 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a819c9d5-deb6-4257-8432-a1ed2a2ecc3e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:27.282721 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a819c9d5-deb6-4257-8432-a1ed2a2ecc3e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:27.283776 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a819c9d5-deb6-4257-8432-a1ed2a2ecc3e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:27.284988 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a819c9d5-deb6-4257-8432-a1ed2a2ecc3e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:27.465569 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-efc4da16-e93c-49d0-9a50-4de957c9d1ad req-a82b3fd8-dffb-4c32-ab02-44ffac314c96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6349f6ac-f05d-4eb0-902d-d70acad20a64", "name": "network-vif-deleted", "tag": "1b308357-2eea-4345-8819-270bbbadb931"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:28:27.474307 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-efc4da16-e93c-49d0-9a50-4de957c9d1ad req-a82b3fd8-dffb-4c32-ab02-44ffac314c96 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:27.474738 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-efc4da16-e93c-49d0-9a50-4de957c9d1ad req-a82b3fd8-dffb-4c32-ab02-44ffac314c96 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:27.488670 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-efc4da16-e93c-49d0-9a50-4de957c9d1ad req-a82b3fd8-dffb-4c32-ab02-44ffac314c96 service nova] Creating event network-vif-deleted:1b308357-2eea-4345-8819-270bbbadb931 for instance 6349f6ac-f05d-4eb0-902d-d70acad20a64 on hv-cinder-84327 May 25 16:28:27.495292 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-efc4da16-e93c-49d0-9a50-4de957c9d1ad req-a82b3fd8-dffb-4c32-ab02-44ffac314c96 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033366 May 25 16:28:27.496326 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 444/896] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:28:27.507995 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-a819c9d5-deb6-4257-8432-a1ed2a2ecc3e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36eda4f44b9428d9ff648979059fb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe1de3697c04df4865c4a145a524231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:27.521415 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-a819c9d5-deb6-4257-8432-a1ed2a2ecc3e tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64" status: 200 len: 1504 microversion: 2.1 time: 0.263365 May 25 16:28:27.531380 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 453/897] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:27 2022] GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64 => generated 1504 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:28:28.539512 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-c9d60454-9015-40fa-a9e7-68a28d915663 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:28.540940 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-c9d60454-9015-40fa-a9e7-68a28d915663 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] [instance: 6349f6ac-f05d-4eb0-902d-d70acad20a64] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:28.547704 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c9d60454-9015-40fa-a9e7-68a28d915663 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:28.548152 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c9d60454-9015-40fa-a9e7-68a28d915663 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:28.548908 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c9d60454-9015-40fa-a9e7-68a28d915663 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:28.549344 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c9d60454-9015-40fa-a9e7-68a28d915663 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:28.563744 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.wsgi [None req-c9d60454-9015-40fa-a9e7-68a28d915663 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] HTTP exception thrown: Instance 6349f6ac-f05d-4eb0-902d-d70acad20a64 could not be found. May 25 16:28:28.565405 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-c9d60454-9015-40fa-a9e7-68a28d915663 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Request method failure captured: May 25 16:28:28.565405 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: request: GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64 HTTP/1.1 May 25 16:28:28.565405 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept: application/json May 25 16:28:28.565405 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept-Encoding: identity May 25 16:28:28.565405 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Connection: close May 25 16:28:28.565405 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Length: 0 May 25 16:28:28.565405 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Type: application/json May 25 16:28:28.565405 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Host: 10.222.0.42 May 25 16:28:28.565405 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Openstack-System-Scope: None May 25 16:28:28.565405 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: User-Agent: python-urllib3/1.26.9 May 25 16:28:28.565405 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Auth-Token: gAAAAABijlkHGQNB2LE_VPMufDuH-3RHz54tKH5yGAHe84J3JX06PbTjpiRu64NUH6UUdYjIuErL_uVvCwyMCyrTq6N3Sokklv9lK2lnDqZdEDvRQ3k3V8dkLoZRIEgUsmWcgTcOjH5AhAyW-H9MBRATG7-zLv4rq2ignEv1TxCO4i9uIOJ2fgg May 25 16:28:28.565405 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Id: None May 25 16:28:28.565405 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Name: None May 25 16:28:28.565405 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Identity-Status: Confirmed May 25 16:28:28.565405 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Is-Admin-Project: True May 25 16:28:28.565405 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Id: default May 25 16:28:28.565405 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Name: Default May 25 16:28:28.565405 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Id: 1fe1de3697c04df4865c4a145a524231 May 25 16:28:28.565405 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Name: tempest-VolumesActionsTest-408508027 May 25 16:28:28.565405 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Role: reader,member May 25 16:28:28.565405 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Roles: reader,member May 25 16:28:28.567127 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1fe1de3697c04df4865c4a145a524231"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1fe1de3697c04df4865c4a145a524231"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1fe1de3697c04df4865c4a145a524231"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1fe1de3697c04df4865c4a145a524231"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:28:28.567127 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant: tempest-VolumesActionsTest-408508027 May 25 16:28:28.567127 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Id: 1fe1de3697c04df4865c4a145a524231 May 25 16:28:28.567127 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Name: tempest-VolumesActionsTest-408508027 May 25 16:28:28.567127 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User: tempest-VolumesActionsTest-408508027-project May 25 16:28:28.567127 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Id: default May 25 16:28:28.567127 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Name: Default May 25 16:28:28.567127 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Id: b36eda4f44b9428d9ff648979059fb5b May 25 16:28:28.567127 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Name: tempest-VolumesActionsTest-408508027-project May 25 16:28:28.567127 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: method: > May 25 16:28:28.567127 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: exception: Instance 6349f6ac-f05d-4eb0-902d-d70acad20a64 could not be found. May 25 16:28:28.567127 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: action_args: {'id': '6349f6ac-f05d-4eb0-902d-d70acad20a64'} May 25 16:28:28.567967 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:28:28.567967 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:28:28.567967 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:28:28.567967 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:28:28.567967 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:28:28.567967 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:28:28.567967 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:28:28.567967 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:28:28.567967 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:28:28.567967 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:28:28.567967 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6349f6ac-f05d-4eb0-902d-d70acad20a64 could not be found. May 25 16:28:28.567967 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:28:28.567967 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:28:28.567967 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:28:28.567967 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:28:28.567967 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:28:28.567967 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:28:28.567967 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:28:28.567967 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:28:28.567967 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:28:28.569231 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:28:28.569231 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:28:28.569231 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:28:28.569231 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:28:28.569231 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:28:28.569231 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:28:28.569231 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:28:28.569231 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6349f6ac-f05d-4eb0-902d-d70acad20a64 could not be found. May 25 16:28:28.569231 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:28:28.569231 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:28:28.569231 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:28:28.569231 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:28:28.569231 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:28:28.569231 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:28:28.569231 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:28:28.569231 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:28:28.569231 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6349f6ac-f05d-4eb0-902d-d70acad20a64 could not be found. May 25 16:28:28.569231 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:28:28.570449 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-c9d60454-9015-40fa-a9e7-68a28d915663 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] Returning 404 to user: Instance 6349f6ac-f05d-4eb0-902d-d70acad20a64 could not be found. {{(pid=117510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:28:28.570449 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-c9d60454-9015-40fa-a9e7-68a28d915663 tempest-VolumesActionsTest-408508027 tempest-VolumesActionsTest-408508027-project] 10.222.0.42 "GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64" status: 404 len: 111 microversion: 2.1 time: 0.031833 May 25 16:28:28.570449 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 445/898] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:28 2022] GET /compute/v2.1/servers/6349f6ac-f05d-4eb0-902d-d70acad20a64 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:28:56.926883 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-b84bfea3-34d6-4c80-a2c0-f8cf4cac41fb tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1787708297", "imageRef": "e74cccc1-cd1b-4dfc-8e47-3e4a832649a8", "flavorRef": "452"}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:28:56.943568 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_api:SELECT=5 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:28:56.944707 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=76 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:28:57.014163 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.network.neutron [None req-b84bfea3-34d6-4c80-a2c0-f8cf4cac41fb tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] validate_networks() for None {{(pid=117509) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:28:57.395736 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-b84bfea3-34d6-4c80-a2c0-f8cf4cac41fb tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Flavor limits 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:28:57.396725 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-b84bfea3-34d6-4c80-a2c0-f8cf4cac41fb tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Image limits 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:28:57.397316 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-b84bfea3-34d6-4c80-a2c0-f8cf4cac41fb tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Flavor pref 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:28:57.397859 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-b84bfea3-34d6-4c80-a2c0-f8cf4cac41fb tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Image pref 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:28:57.398395 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-b84bfea3-34d6-4c80-a2c0-f8cf4cac41fb tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:28:57.409986 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b84bfea3-34d6-4c80-a2c0-f8cf4cac41fb tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:57.410775 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b84bfea3-34d6-4c80-a2c0-f8cf4cac41fb tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:57.412057 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b84bfea3-34d6-4c80-a2c0-f8cf4cac41fb tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:57.412727 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b84bfea3-34d6-4c80-a2c0-f8cf4cac41fb tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:57.438723 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-b84bfea3-34d6-4c80-a2c0-f8cf4cac41fb tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Getting quotas for project d77ca289b79f4074b17d3333288108e5. Resources: {'ram', 'cores', 'instances'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:28:57.444642 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-b84bfea3-34d6-4c80-a2c0-f8cf4cac41fb tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Getting quotas for user 779e791d332947bd88631e5e84b38669 and project d77ca289b79f4074b17d3333288108e5. Resources: {'ram', 'cores', 'instances'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:28:57.462068 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-b84bfea3-34d6-4c80-a2c0-f8cf4cac41fb tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Going to run 1 instances... {{(pid=117509) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:28:57.465368 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-b84bfea3-34d6-4c80-a2c0-f8cf4cac41fb tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] [instance: a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e74cccc1-cd1b-4dfc-8e47-3e4a832649a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:28:57.549792 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-b84bfea3-34d6-4c80-a2c0-f8cf4cac41fb tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.628210 May 25 16:28:57.556617 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 454/899] 10.222.0.42 () {60 vars in 1146 bytes} [Wed May 25 16:28:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:28:57.565309 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-a6c98888-ab8b-4b1f-8bea-c686144146ef tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:57.567040 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-a6c98888-ab8b-4b1f-8bea-c686144146ef tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] [instance: a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:57.569586 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:28:57.587442 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:28:57.738261 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-a6c98888-ab8b-4b1f-8bea-c686144146ef tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e791d332947bd88631e5e84b38669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77ca289b79f4074b17d3333288108e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:57.756130 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-a6c98888-ab8b-4b1f-8bea-c686144146ef tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] 10.222.0.42 "GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f" status: 200 len: 1215 microversion: 2.1 time: 0.198076 May 25 16:28:57.761795 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 446/900] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:57 2022] GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f => generated 1215 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:28:58.778851 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-65b655e3-8988-4c7e-8788-8eac921b3088 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:58.784074 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-65b655e3-8988-4c7e-8788-8eac921b3088 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] [instance: a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:58.799789 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-65b655e3-8988-4c7e-8788-8eac921b3088 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:58.800465 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-65b655e3-8988-4c7e-8788-8eac921b3088 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:58.801399 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-65b655e3-8988-4c7e-8788-8eac921b3088 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:58.802019 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-65b655e3-8988-4c7e-8788-8eac921b3088 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:58.891336 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-65b655e3-8988-4c7e-8788-8eac921b3088 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e791d332947bd88631e5e84b38669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77ca289b79f4074b17d3333288108e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:28:58.924482 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-65b655e3-8988-4c7e-8788-8eac921b3088 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] 10.222.0.42 "GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f" status: 200 len: 1267 microversion: 2.1 time: 0.143927 May 25 16:28:58.925399 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 455/901] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:58 2022] GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:28:59.943347 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-02e812e0-7775-4256-b563-4b39eb7c1050 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:28:59.944163 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-02e812e0-7775-4256-b563-4b39eb7c1050 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] [instance: a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:28:59.957898 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-02e812e0-7775-4256-b563-4b39eb7c1050 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:59.958622 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-02e812e0-7775-4256-b563-4b39eb7c1050 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:28:59.959410 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-02e812e0-7775-4256-b563-4b39eb7c1050 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:28:59.964042 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-02e812e0-7775-4256-b563-4b39eb7c1050 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:00.052716 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-02e812e0-7775-4256-b563-4b39eb7c1050 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e791d332947bd88631e5e84b38669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77ca289b79f4074b17d3333288108e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:00.063764 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-02e812e0-7775-4256-b563-4b39eb7c1050 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] 10.222.0.42 "GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f" status: 200 len: 1273 microversion: 2.1 time: 0.124355 May 25 16:29:00.074189 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 447/902] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:28:59 2022] GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f => generated 1273 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:01.087286 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-44745d2e-39b3-4113-9963-d9bcb5719c08 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:01.089081 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-44745d2e-39b3-4113-9963-d9bcb5719c08 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] [instance: a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:01.107063 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-44745d2e-39b3-4113-9963-d9bcb5719c08 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:01.107726 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-44745d2e-39b3-4113-9963-d9bcb5719c08 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:01.108664 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-44745d2e-39b3-4113-9963-d9bcb5719c08 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:01.109244 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-44745d2e-39b3-4113-9963-d9bcb5719c08 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:01.319023 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-b0d43e6c-53ae-4f41-ba89-6c913fa5cd95 req-236c1395-7cd9-423c-b9e1-6811332f39f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f", "tag": "6bf0f2f7-c219-4be5-a699-34ed7b6a97c7"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:29:01.335385 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-b0d43e6c-53ae-4f41-ba89-6c913fa5cd95 req-236c1395-7cd9-423c-b9e1-6811332f39f2 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:01.335920 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-b0d43e6c-53ae-4f41-ba89-6c913fa5cd95 req-236c1395-7cd9-423c-b9e1-6811332f39f2 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:01.341579 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-44745d2e-39b3-4113-9963-d9bcb5719c08 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e791d332947bd88631e5e84b38669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77ca289b79f4074b17d3333288108e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:01.353091 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-44745d2e-39b3-4113-9963-d9bcb5719c08 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] 10.222.0.42 "GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f" status: 200 len: 1315 microversion: 2.1 time: 0.271804 May 25 16:29:01.356176 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 456/903] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:01 2022] GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:01.376926 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-b0d43e6c-53ae-4f41-ba89-6c913fa5cd95 req-236c1395-7cd9-423c-b9e1-6811332f39f2 service nova] Creating event network-changed:6bf0f2f7-c219-4be5-a699-34ed7b6a97c7 for instance a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f on hv-cinder-84327 May 25 16:29:01.384916 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-b0d43e6c-53ae-4f41-ba89-6c913fa5cd95 req-236c1395-7cd9-423c-b9e1-6811332f39f2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069419 May 25 16:29:01.385964 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 448/904] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:29:02.373086 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-2ea5dd5d-eac5-4e0e-b1c1-2eaa1a719219 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:02.374388 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-2ea5dd5d-eac5-4e0e-b1c1-2eaa1a719219 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] [instance: a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:02.382793 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2ea5dd5d-eac5-4e0e-b1c1-2eaa1a719219 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:02.383605 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2ea5dd5d-eac5-4e0e-b1c1-2eaa1a719219 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:02.384630 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2ea5dd5d-eac5-4e0e-b1c1-2eaa1a719219 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:02.385377 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2ea5dd5d-eac5-4e0e-b1c1-2eaa1a719219 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:02.572075 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-2ea5dd5d-eac5-4e0e-b1c1-2eaa1a719219 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e791d332947bd88631e5e84b38669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77ca289b79f4074b17d3333288108e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:02.586939 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-2ea5dd5d-eac5-4e0e-b1c1-2eaa1a719219 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] 10.222.0.42 "GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f" status: 200 len: 1315 microversion: 2.1 time: 0.219027 May 25 16:29:02.587515 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 457/905] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:02 2022] GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:03.605067 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-7296c839-b2dd-4be3-8f24-3d25f998ba26 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:03.605907 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-7296c839-b2dd-4be3-8f24-3d25f998ba26 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] [instance: a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:03.617014 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7296c839-b2dd-4be3-8f24-3d25f998ba26 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:03.619670 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7296c839-b2dd-4be3-8f24-3d25f998ba26 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:03.621587 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7296c839-b2dd-4be3-8f24-3d25f998ba26 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:03.624140 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7296c839-b2dd-4be3-8f24-3d25f998ba26 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:03.786215 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-7296c839-b2dd-4be3-8f24-3d25f998ba26 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e791d332947bd88631e5e84b38669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77ca289b79f4074b17d3333288108e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:03.797020 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-7296c839-b2dd-4be3-8f24-3d25f998ba26 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] 10.222.0.42 "GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f" status: 200 len: 1315 microversion: 2.1 time: 0.197059 May 25 16:29:03.798210 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 449/906] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:03 2022] GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:04.816445 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-ad367be7-ae8f-46c0-ad50-536d3f36b674 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:04.818050 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-ad367be7-ae8f-46c0-ad50-536d3f36b674 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] [instance: a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:04.831015 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ad367be7-ae8f-46c0-ad50-536d3f36b674 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:04.832463 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ad367be7-ae8f-46c0-ad50-536d3f36b674 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:04.834931 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ad367be7-ae8f-46c0-ad50-536d3f36b674 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:04.836600 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ad367be7-ae8f-46c0-ad50-536d3f36b674 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:05.010178 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-ad367be7-ae8f-46c0-ad50-536d3f36b674 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e791d332947bd88631e5e84b38669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77ca289b79f4074b17d3333288108e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:05.019141 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-ad367be7-ae8f-46c0-ad50-536d3f36b674 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] 10.222.0.42 "GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f" status: 200 len: 1315 microversion: 2.1 time: 0.208999 May 25 16:29:05.020531 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 458/907] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:04 2022] GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:06.036712 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-76bd1bce-71d2-46d2-b9d1-1db5e3597fdf tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:06.037653 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-76bd1bce-71d2-46d2-b9d1-1db5e3597fdf tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] [instance: a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:06.045349 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-76bd1bce-71d2-46d2-b9d1-1db5e3597fdf tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:06.046137 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-76bd1bce-71d2-46d2-b9d1-1db5e3597fdf tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:06.046901 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-76bd1bce-71d2-46d2-b9d1-1db5e3597fdf tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:06.047715 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-76bd1bce-71d2-46d2-b9d1-1db5e3597fdf tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:06.211058 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-76bd1bce-71d2-46d2-b9d1-1db5e3597fdf tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e791d332947bd88631e5e84b38669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77ca289b79f4074b17d3333288108e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:06.222661 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-76bd1bce-71d2-46d2-b9d1-1db5e3597fdf tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] 10.222.0.42 "GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f" status: 200 len: 1315 microversion: 2.1 time: 0.190046 May 25 16:29:06.223533 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 450/908] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:06 2022] GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:07.240735 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-7e8ef183-2847-48ea-97be-6c63bab54311 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:07.242192 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-7e8ef183-2847-48ea-97be-6c63bab54311 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] [instance: a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:07.249627 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7e8ef183-2847-48ea-97be-6c63bab54311 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:07.249881 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7e8ef183-2847-48ea-97be-6c63bab54311 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:07.250874 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7e8ef183-2847-48ea-97be-6c63bab54311 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:07.251382 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7e8ef183-2847-48ea-97be-6c63bab54311 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:07.417438 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-7e8ef183-2847-48ea-97be-6c63bab54311 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e791d332947bd88631e5e84b38669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77ca289b79f4074b17d3333288108e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:07.424111 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell0:SELECT=2 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:29:07.426590 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-7e8ef183-2847-48ea-97be-6c63bab54311 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] 10.222.0.42 "GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f" status: 200 len: 1315 microversion: 2.1 time: 0.189546 May 25 16:29:07.437275 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 459/909] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:07 2022] GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:07.913096 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-9e6e1000-093a-43c7-b358-9a778da29c3a tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Action: 'create', calling method: .version_select at 0x7f51ed9fdd30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-234239692", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWTWwI1PW6gLWQ3hKiWqNQ/OChpGao7gRSjIwJqMsHe0cbwMCNNik1LyaxBokeTMUtxnnvgmzuT+CcvqQQ7kzWRmndIK6gtx7tlblELQvUspHBXpqnT9scoHV7Wl6II6Q=="}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:29:07.918281 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell0:SELECT=2 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:29:07.929099 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-9e6e1000-093a-43c7-b358-9a778da29c3a tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Getting quotas for project c8efc0621a1242329970cda13b3fee4b. Resources: {'key_pairs'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:29:07.933150 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-9e6e1000-093a-43c7-b358-9a778da29c3a tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Getting quotas for user fcca87cd01ae464cb1484c3bbd52aaf6 and project c8efc0621a1242329970cda13b3fee4b. Resources: {'key_pairs'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:29:07.954145 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-9e6e1000-093a-43c7-b358-9a778da29c3a tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.045125 May 25 16:29:07.954714 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 451/910] 10.222.0.42 () {60 vars in 1158 bytes} [Wed May 25 16:29:07 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:29:08.054292 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-acdcdc12-37de-49d6-971b-43cb6aa6dc06 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1964333904", "imageRef": "2ba32f9f-7afa-4e48-91e7-bf289a060d35", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-234239692", "networks": [{"uuid": "3208438a-9fe5-4561-8a67-505a574fed46"}]}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:29:08.060932 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell0:SELECT=6 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:29:08.105345 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.network.neutron [None req-acdcdc12-37de-49d6-971b-43cb6aa6dc06 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] validate_networks() for [('3208438a-9fe5-4561-8a67-505a574fed46', None, None, None, None, None)] {{(pid=117509) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:29:08.439880 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-0a997430-ef53-4cd1-91b6-ef3dd8f178ad req-4eb33f1b-ac3b-4dcc-8b06-334e7c3cf592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f", "name": "network-vif-plugged", "status": "completed", "tag": "6bf0f2f7-c219-4be5-a699-34ed7b6a97c7"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:29:08.448415 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-0a997430-ef53-4cd1-91b6-ef3dd8f178ad req-4eb33f1b-ac3b-4dcc-8b06-334e7c3cf592 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:08.449338 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-0a997430-ef53-4cd1-91b6-ef3dd8f178ad req-4eb33f1b-ac3b-4dcc-8b06-334e7c3cf592 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:08.460957 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-0a997430-ef53-4cd1-91b6-ef3dd8f178ad req-4eb33f1b-ac3b-4dcc-8b06-334e7c3cf592 service nova] Creating event network-vif-plugged:6bf0f2f7-c219-4be5-a699-34ed7b6a97c7 for instance a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f on hv-cinder-84327 May 25 16:29:08.467006 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-0a997430-ef53-4cd1-91b6-ef3dd8f178ad req-4eb33f1b-ac3b-4dcc-8b06-334e7c3cf592 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035017 May 25 16:29:08.467664 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 452/911] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:29:08.472765 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-30407dd7-a87a-4022-8f45-a9009fa236fa tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:08.473663 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-30407dd7-a87a-4022-8f45-a9009fa236fa tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] [instance: a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:08.485083 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-30407dd7-a87a-4022-8f45-a9009fa236fa tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:08.487258 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-30407dd7-a87a-4022-8f45-a9009fa236fa tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:08.488654 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-30407dd7-a87a-4022-8f45-a9009fa236fa tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:08.489142 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-30407dd7-a87a-4022-8f45-a9009fa236fa tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:08.523718 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-acdcdc12-37de-49d6-971b-43cb6aa6dc06 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Flavor limits 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:29:08.524291 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-acdcdc12-37de-49d6-971b-43cb6aa6dc06 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Image limits 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:29:08.524596 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-acdcdc12-37de-49d6-971b-43cb6aa6dc06 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Flavor pref 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:29:08.525055 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-acdcdc12-37de-49d6-971b-43cb6aa6dc06 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Image pref 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:29:08.525445 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-acdcdc12-37de-49d6-971b-43cb6aa6dc06 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:29:08.538051 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-acdcdc12-37de-49d6-971b-43cb6aa6dc06 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:08.538497 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-acdcdc12-37de-49d6-971b-43cb6aa6dc06 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:08.539743 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-acdcdc12-37de-49d6-971b-43cb6aa6dc06 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:08.540762 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-acdcdc12-37de-49d6-971b-43cb6aa6dc06 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:08.561573 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-acdcdc12-37de-49d6-971b-43cb6aa6dc06 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Getting quotas for project c8efc0621a1242329970cda13b3fee4b. Resources: {'ram', 'cores', 'instances'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:29:08.567820 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-acdcdc12-37de-49d6-971b-43cb6aa6dc06 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Getting quotas for user fcca87cd01ae464cb1484c3bbd52aaf6 and project c8efc0621a1242329970cda13b3fee4b. Resources: {'ram', 'cores', 'instances'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:29:08.583216 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-acdcdc12-37de-49d6-971b-43cb6aa6dc06 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Going to run 1 instances... {{(pid=117509) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:29:08.585773 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-acdcdc12-37de-49d6-971b-43cb6aa6dc06 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ba32f9f-7afa-4e48-91e7-bf289a060d35',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:29:08.640776 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-acdcdc12-37de-49d6-971b-43cb6aa6dc06 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590819 May 25 16:29:08.641813 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 460/912] 10.222.0.42 () {60 vars in 1146 bytes} [Wed May 25 16:29:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:29:08.652653 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-dff18d05-7a01-4eb0-abf7-8274f52e7426 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:08.653922 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-dff18d05-7a01-4eb0-abf7-8274f52e7426 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:08.655049 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-30407dd7-a87a-4022-8f45-a9009fa236fa tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e791d332947bd88631e5e84b38669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77ca289b79f4074b17d3333288108e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:08.674044 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-30407dd7-a87a-4022-8f45-a9009fa236fa tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] 10.222.0.42 "GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f" status: 200 len: 1315 microversion: 2.1 time: 0.204963 May 25 16:29:08.674762 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 453/913] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:08 2022] GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:08.725112 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-dff18d05-7a01-4eb0-abf7-8274f52e7426 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:08.732099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-dff18d05-7a01-4eb0-abf7-8274f52e7426 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1258 microversion: 2.1 time: 0.084584 May 25 16:29:08.732678 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 461/914] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:08 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1258 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:09.691425 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-920d81db-57f8-4b2a-a58b-7df349a4f7f0 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:09.692045 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-920d81db-57f8-4b2a-a58b-7df349a4f7f0 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] [instance: a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:09.699752 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-920d81db-57f8-4b2a-a58b-7df349a4f7f0 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:09.700184 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-920d81db-57f8-4b2a-a58b-7df349a4f7f0 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:09.700963 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-920d81db-57f8-4b2a-a58b-7df349a4f7f0 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:09.701398 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-920d81db-57f8-4b2a-a58b-7df349a4f7f0 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:09.750184 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-ca00a283-7ccd-47e8-b6f3-a140c36af82b tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:09.750904 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-ca00a283-7ccd-47e8-b6f3-a140c36af82b tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:09.759384 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ca00a283-7ccd-47e8-b6f3-a140c36af82b tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:09.769592 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ca00a283-7ccd-47e8-b6f3-a140c36af82b tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:09.770806 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ca00a283-7ccd-47e8-b6f3-a140c36af82b tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:09.771426 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ca00a283-7ccd-47e8-b6f3-a140c36af82b tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:09.859558 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-ca00a283-7ccd-47e8-b6f3-a140c36af82b tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:09.876673 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-ca00a283-7ccd-47e8-b6f3-a140c36af82b tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1310 microversion: 2.1 time: 0.130104 May 25 16:29:09.877298 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 462/915] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:09 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1310 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:29:09.892943 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-920d81db-57f8-4b2a-a58b-7df349a4f7f0 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e791d332947bd88631e5e84b38669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77ca289b79f4074b17d3333288108e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:09.901908 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-920d81db-57f8-4b2a-a58b-7df349a4f7f0 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] 10.222.0.42 "GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f" status: 200 len: 1315 microversion: 2.1 time: 0.214292 May 25 16:29:09.902690 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 454/916] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:09 2022] GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:10.896036 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-b58a3af7-1327-46c6-8a50-a0ce5cc5c246 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:10.897576 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-b58a3af7-1327-46c6-8a50-a0ce5cc5c246 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:10.908902 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b58a3af7-1327-46c6-8a50-a0ce5cc5c246 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:10.911441 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b58a3af7-1327-46c6-8a50-a0ce5cc5c246 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:10.914071 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b58a3af7-1327-46c6-8a50-a0ce5cc5c246 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:10.914771 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b58a3af7-1327-46c6-8a50-a0ce5cc5c246 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:10.921663 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-0a796ea2-b513-43b6-9d43-0b9b2af18d7c tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:10.922309 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-0a796ea2-b513-43b6-9d43-0b9b2af18d7c tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] [instance: a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:10.943511 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0a796ea2-b513-43b6-9d43-0b9b2af18d7c tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:10.944129 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0a796ea2-b513-43b6-9d43-0b9b2af18d7c tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:10.944972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0a796ea2-b513-43b6-9d43-0b9b2af18d7c tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:10.945407 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0a796ea2-b513-43b6-9d43-0b9b2af18d7c tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:11.328359 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-b58a3af7-1327-46c6-8a50-a0ce5cc5c246 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:11.360271 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-b58a3af7-1327-46c6-8a50-a0ce5cc5c246 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1358 microversion: 2.1 time: 0.467947 May 25 16:29:11.372611 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 463/917] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:10 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1358 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:11.402166 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-0a796ea2-b513-43b6-9d43-0b9b2af18d7c tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e791d332947bd88631e5e84b38669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77ca289b79f4074b17d3333288108e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:11.415756 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-0a796ea2-b513-43b6-9d43-0b9b2af18d7c tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] 10.222.0.42 "GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f" status: 200 len: 1465 microversion: 2.1 time: 0.499360 May 25 16:29:11.431352 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 455/918] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:10 2022] GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f => generated 1465 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:11.491896 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-d2dec69d-c5cf-4fd9-a0f3-efc1a3d1ef51 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:11.492681 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-d2dec69d-c5cf-4fd9-a0f3-efc1a3d1ef51 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] [instance: a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:11.501066 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d2dec69d-c5cf-4fd9-a0f3-efc1a3d1ef51 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:11.502012 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d2dec69d-c5cf-4fd9-a0f3-efc1a3d1ef51 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:11.503083 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d2dec69d-c5cf-4fd9-a0f3-efc1a3d1ef51 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:11.503840 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d2dec69d-c5cf-4fd9-a0f3-efc1a3d1ef51 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:11.551281 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-d2dec69d-c5cf-4fd9-a0f3-efc1a3d1ef51 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] [instance: a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f] Going to try to terminate instance {{(pid=117509) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:29:11.653278 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-d2dec69d-c5cf-4fd9-a0f3-efc1a3d1ef51 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f" status: 204 len: 0 microversion: 2.1 time: 0.166420 May 25 16:29:11.663007 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-22f9ef22-5f68-440a-9cda-4f51e4cc0234 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:11.663641 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-22f9ef22-5f68-440a-9cda-4f51e4cc0234 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] [instance: a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:11.665879 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 464/919] 10.222.0.42 () {58 vars in 1238 bytes} [Wed May 25 16:29:11 2022] DELETE /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:29:11.670285 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-22f9ef22-5f68-440a-9cda-4f51e4cc0234 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:11.670734 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-22f9ef22-5f68-440a-9cda-4f51e4cc0234 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:11.671749 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-22f9ef22-5f68-440a-9cda-4f51e4cc0234 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:11.672186 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-22f9ef22-5f68-440a-9cda-4f51e4cc0234 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:11.846593 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-22f9ef22-5f68-440a-9cda-4f51e4cc0234 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e791d332947bd88631e5e84b38669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77ca289b79f4074b17d3333288108e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:11.855046 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-22f9ef22-5f68-440a-9cda-4f51e4cc0234 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] 10.222.0.42 "GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f" status: 200 len: 1471 microversion: 2.1 time: 0.195692 May 25 16:29:11.855737 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 456/920] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:11 2022] GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f => generated 1471 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:12.381177 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-83563933-ab86-45e4-a62b-bc643573482c tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:12.382193 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-83563933-ab86-45e4-a62b-bc643573482c tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:12.389051 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-83563933-ab86-45e4-a62b-bc643573482c tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:12.389653 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-83563933-ab86-45e4-a62b-bc643573482c tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:12.390679 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-83563933-ab86-45e4-a62b-bc643573482c tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:12.391307 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-83563933-ab86-45e4-a62b-bc643573482c tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:12.547608 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-83563933-ab86-45e4-a62b-bc643573482c tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:12.555182 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-83563933-ab86-45e4-a62b-bc643573482c tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1358 microversion: 2.1 time: 0.178787 May 25 16:29:12.557776 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 465/921] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:12 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:12.873057 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-9e017f93-b81e-4693-a073-1308ce5bbad8 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:12.873672 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-9e017f93-b81e-4693-a073-1308ce5bbad8 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] [instance: a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:12.880227 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9e017f93-b81e-4693-a073-1308ce5bbad8 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:12.880680 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9e017f93-b81e-4693-a073-1308ce5bbad8 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:12.881452 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9e017f93-b81e-4693-a073-1308ce5bbad8 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:12.881936 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9e017f93-b81e-4693-a073-1308ce5bbad8 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:13.027655 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-9e017f93-b81e-4693-a073-1308ce5bbad8 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e791d332947bd88631e5e84b38669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77ca289b79f4074b17d3333288108e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:13.035041 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-9e017f93-b81e-4693-a073-1308ce5bbad8 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] 10.222.0.42 "GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f" status: 200 len: 1471 microversion: 2.1 time: 0.166488 May 25 16:29:13.035598 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 457/922] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:12 2022] GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f => generated 1471 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:13.572088 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-99751bc1-c230-454d-92e5-b71bdc9d5320 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:13.572766 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-99751bc1-c230-454d-92e5-b71bdc9d5320 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:13.579767 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-99751bc1-c230-454d-92e5-b71bdc9d5320 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:13.580208 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-99751bc1-c230-454d-92e5-b71bdc9d5320 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:13.580963 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-99751bc1-c230-454d-92e5-b71bdc9d5320 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:13.581391 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-99751bc1-c230-454d-92e5-b71bdc9d5320 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:13.718557 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-99751bc1-c230-454d-92e5-b71bdc9d5320 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:13.726590 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-99751bc1-c230-454d-92e5-b71bdc9d5320 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1358 microversion: 2.1 time: 0.158207 May 25 16:29:13.727507 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 466/923] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:13 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:14.052203 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-8c7f4989-e4f6-4fd7-9a29-c7a21aa7dfd9 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:14.052802 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-8c7f4989-e4f6-4fd7-9a29-c7a21aa7dfd9 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] [instance: a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:14.061215 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8c7f4989-e4f6-4fd7-9a29-c7a21aa7dfd9 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:14.061668 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8c7f4989-e4f6-4fd7-9a29-c7a21aa7dfd9 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:14.062767 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8c7f4989-e4f6-4fd7-9a29-c7a21aa7dfd9 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:14.063211 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8c7f4989-e4f6-4fd7-9a29-c7a21aa7dfd9 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:14.197147 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-8c7f4989-e4f6-4fd7-9a29-c7a21aa7dfd9 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e791d332947bd88631e5e84b38669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77ca289b79f4074b17d3333288108e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:14.205675 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-8c7f4989-e4f6-4fd7-9a29-c7a21aa7dfd9 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] 10.222.0.42 "GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f" status: 200 len: 1471 microversion: 2.1 time: 0.157174 May 25 16:29:14.206275 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 458/924] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:14 2022] GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f => generated 1471 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:14.745307 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-e29f594b-e2b0-4030-a64f-315b78bc142e tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:14.746883 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-e29f594b-e2b0-4030-a64f-315b78bc142e tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:14.754210 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e29f594b-e2b0-4030-a64f-315b78bc142e tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:14.754981 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e29f594b-e2b0-4030-a64f-315b78bc142e tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:14.756115 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e29f594b-e2b0-4030-a64f-315b78bc142e tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:14.756777 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e29f594b-e2b0-4030-a64f-315b78bc142e tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:14.894501 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-e29f594b-e2b0-4030-a64f-315b78bc142e tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:14.902391 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-e29f594b-e2b0-4030-a64f-315b78bc142e tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1358 microversion: 2.1 time: 0.162129 May 25 16:29:14.902979 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 467/925] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:14 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:15.224667 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-3f5d7b29-a822-436a-81ee-590185ada2cd tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:15.226184 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-3f5d7b29-a822-436a-81ee-590185ada2cd tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] [instance: a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:15.234096 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3f5d7b29-a822-436a-81ee-590185ada2cd tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:15.235274 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3f5d7b29-a822-436a-81ee-590185ada2cd tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:15.236309 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3f5d7b29-a822-436a-81ee-590185ada2cd tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:15.237214 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3f5d7b29-a822-436a-81ee-590185ada2cd tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:15.394836 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-3f5d7b29-a822-436a-81ee-590185ada2cd tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e791d332947bd88631e5e84b38669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77ca289b79f4074b17d3333288108e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:15.404522 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-3f5d7b29-a822-436a-81ee-590185ada2cd tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] 10.222.0.42 "GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f" status: 200 len: 1471 microversion: 2.1 time: 0.183696 May 25 16:29:15.415294 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 459/926] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:15 2022] GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f => generated 1471 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:15.919905 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-9b1f0bcb-9af0-4d5d-9363-8f6dc1614fe5 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:15.920512 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-9b1f0bcb-9af0-4d5d-9363-8f6dc1614fe5 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:15.928074 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9b1f0bcb-9af0-4d5d-9363-8f6dc1614fe5 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:15.928547 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9b1f0bcb-9af0-4d5d-9363-8f6dc1614fe5 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:15.929380 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9b1f0bcb-9af0-4d5d-9363-8f6dc1614fe5 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:15.930032 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9b1f0bcb-9af0-4d5d-9363-8f6dc1614fe5 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:16.082066 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-9b1f0bcb-9af0-4d5d-9363-8f6dc1614fe5 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:16.090853 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-9b1f0bcb-9af0-4d5d-9363-8f6dc1614fe5 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1358 microversion: 2.1 time: 0.175526 May 25 16:29:16.091505 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 468/927] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:15 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:16.423013 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-18917e56-c3ea-4fb7-8147-742099df348f tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:16.423599 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-18917e56-c3ea-4fb7-8147-742099df348f tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] [instance: a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:16.430099 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-18917e56-c3ea-4fb7-8147-742099df348f tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:16.430546 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-18917e56-c3ea-4fb7-8147-742099df348f tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:16.431307 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-18917e56-c3ea-4fb7-8147-742099df348f tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:16.431738 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-18917e56-c3ea-4fb7-8147-742099df348f tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:16.588496 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-18917e56-c3ea-4fb7-8147-742099df348f tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e791d332947bd88631e5e84b38669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77ca289b79f4074b17d3333288108e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:16.604752 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-18917e56-c3ea-4fb7-8147-742099df348f tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] 10.222.0.42 "GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f" status: 200 len: 1471 microversion: 2.1 time: 0.185558 May 25 16:29:16.605339 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 460/928] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:16 2022] GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f => generated 1471 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:17.108487 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-6d173daf-f303-44ea-9dc2-cdc0bd4794a9 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:17.110018 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-6d173daf-f303-44ea-9dc2-cdc0bd4794a9 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:17.117440 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6d173daf-f303-44ea-9dc2-cdc0bd4794a9 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:17.118224 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6d173daf-f303-44ea-9dc2-cdc0bd4794a9 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:17.119005 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6d173daf-f303-44ea-9dc2-cdc0bd4794a9 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:17.119642 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6d173daf-f303-44ea-9dc2-cdc0bd4794a9 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:17.268206 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-6d173daf-f303-44ea-9dc2-cdc0bd4794a9 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:17.277934 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-6d173daf-f303-44ea-9dc2-cdc0bd4794a9 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1358 microversion: 2.1 time: 0.173325 May 25 16:29:17.278856 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 469/929] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:17 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:17.622355 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-62318199-33a5-4bc4-8b26-f4226724b5de tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:17.623003 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-62318199-33a5-4bc4-8b26-f4226724b5de tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] [instance: a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:17.629924 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-62318199-33a5-4bc4-8b26-f4226724b5de tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:17.630492 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-62318199-33a5-4bc4-8b26-f4226724b5de tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:17.631370 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-62318199-33a5-4bc4-8b26-f4226724b5de tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:17.631812 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-62318199-33a5-4bc4-8b26-f4226724b5de tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:17.770552 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-62318199-33a5-4bc4-8b26-f4226724b5de tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e791d332947bd88631e5e84b38669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77ca289b79f4074b17d3333288108e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:17.789831 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-62318199-33a5-4bc4-8b26-f4226724b5de tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] 10.222.0.42 "GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f" status: 200 len: 1471 microversion: 2.1 time: 0.171388 May 25 16:29:17.790972 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 461/930] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:17 2022] GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f => generated 1471 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:18.296612 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-1ce08066-7dfd-4635-a449-dce85a8e7269 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:18.297212 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-1ce08066-7dfd-4635-a449-dce85a8e7269 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:18.303797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1ce08066-7dfd-4635-a449-dce85a8e7269 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:18.304247 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1ce08066-7dfd-4635-a449-dce85a8e7269 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:18.305016 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1ce08066-7dfd-4635-a449-dce85a8e7269 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:18.305450 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1ce08066-7dfd-4635-a449-dce85a8e7269 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:18.457044 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-1ce08066-7dfd-4635-a449-dce85a8e7269 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:18.468611 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-1ce08066-7dfd-4635-a449-dce85a8e7269 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1358 microversion: 2.1 time: 0.176380 May 25 16:29:18.469199 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 470/931] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:18 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:18.808737 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell0:SELECT=4 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:29:18.816149 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-b2ef06f6-1b83-4741-a770-f106a32449dc tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:18.817112 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-b2ef06f6-1b83-4741-a770-f106a32449dc tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] [instance: a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:18.832219 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b2ef06f6-1b83-4741-a770-f106a32449dc tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:18.833644 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b2ef06f6-1b83-4741-a770-f106a32449dc tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:18.834835 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b2ef06f6-1b83-4741-a770-f106a32449dc tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:18.835267 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b2ef06f6-1b83-4741-a770-f106a32449dc tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:19.005680 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-b2ef06f6-1b83-4741-a770-f106a32449dc tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e791d332947bd88631e5e84b38669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77ca289b79f4074b17d3333288108e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:19.015480 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-b2ef06f6-1b83-4741-a770-f106a32449dc tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] 10.222.0.42 "GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f" status: 200 len: 1471 microversion: 2.1 time: 0.208164 May 25 16:29:19.018091 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 462/932] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:18 2022] GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f => generated 1471 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:19.485539 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-dcd25f3b-9ebb-41ac-9c77-bb90139d2541 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:19.486205 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-dcd25f3b-9ebb-41ac-9c77-bb90139d2541 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:19.488081 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell0:SELECT=2 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:29:19.488753 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell0:SELECT=8 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:29:19.495169 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dcd25f3b-9ebb-41ac-9c77-bb90139d2541 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:19.495638 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dcd25f3b-9ebb-41ac-9c77-bb90139d2541 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:19.496549 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dcd25f3b-9ebb-41ac-9c77-bb90139d2541 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:19.496979 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dcd25f3b-9ebb-41ac-9c77-bb90139d2541 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:19.501120 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:29:19.637785 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-dcd25f3b-9ebb-41ac-9c77-bb90139d2541 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:19.645462 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-dcd25f3b-9ebb-41ac-9c77-bb90139d2541 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1358 microversion: 2.1 time: 0.163715 May 25 16:29:19.650569 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 471/933] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:19 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:20.032541 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-a836e931-2e32-4bb7-a4f4-55b4ff65a617 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:20.034330 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-a836e931-2e32-4bb7-a4f4-55b4ff65a617 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] [instance: a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:20.052754 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a836e931-2e32-4bb7-a4f4-55b4ff65a617 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:20.054299 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a836e931-2e32-4bb7-a4f4-55b4ff65a617 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:20.055368 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a836e931-2e32-4bb7-a4f4-55b4ff65a617 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:20.055971 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a836e931-2e32-4bb7-a4f4-55b4ff65a617 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:20.219156 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-a836e931-2e32-4bb7-a4f4-55b4ff65a617 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e791d332947bd88631e5e84b38669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77ca289b79f4074b17d3333288108e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:20.227407 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-a836e931-2e32-4bb7-a4f4-55b4ff65a617 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] 10.222.0.42 "GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f" status: 200 len: 1471 microversion: 2.1 time: 0.198748 May 25 16:29:20.228141 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 463/934] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:20 2022] GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f => generated 1471 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:20.663682 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-a2bbae3d-6848-42e7-9d6e-d6d4a307dbf9 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:20.664276 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-a2bbae3d-6848-42e7-9d6e-d6d4a307dbf9 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:20.671530 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a2bbae3d-6848-42e7-9d6e-d6d4a307dbf9 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:20.671983 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a2bbae3d-6848-42e7-9d6e-d6d4a307dbf9 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:20.672748 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a2bbae3d-6848-42e7-9d6e-d6d4a307dbf9 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:20.673184 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a2bbae3d-6848-42e7-9d6e-d6d4a307dbf9 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:20.807894 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-a2bbae3d-6848-42e7-9d6e-d6d4a307dbf9 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:20.815491 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-a2bbae3d-6848-42e7-9d6e-d6d4a307dbf9 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1358 microversion: 2.1 time: 0.156029 May 25 16:29:20.816046 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 472/935] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:20 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:21.244543 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-36ed526f-5741-4808-9829-e6823d38da2f tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:21.245300 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-36ed526f-5741-4808-9829-e6823d38da2f tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] [instance: a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:21.257211 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-36ed526f-5741-4808-9829-e6823d38da2f tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:21.257663 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-36ed526f-5741-4808-9829-e6823d38da2f tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:21.258463 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-36ed526f-5741-4808-9829-e6823d38da2f tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:21.259086 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-36ed526f-5741-4808-9829-e6823d38da2f tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:21.419581 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-36ed526f-5741-4808-9829-e6823d38da2f tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e791d332947bd88631e5e84b38669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77ca289b79f4074b17d3333288108e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:21.428030 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-36ed526f-5741-4808-9829-e6823d38da2f tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] 10.222.0.42 "GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f" status: 200 len: 1471 microversion: 2.1 time: 0.187418 May 25 16:29:21.434955 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 464/936] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:21 2022] GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f => generated 1471 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:21.834192 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-8740233f-bc67-4968-a9c3-f14a10e77a50 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:21.835430 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-8740233f-bc67-4968-a9c3-f14a10e77a50 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:21.842910 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8740233f-bc67-4968-a9c3-f14a10e77a50 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:21.843363 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8740233f-bc67-4968-a9c3-f14a10e77a50 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:21.844144 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8740233f-bc67-4968-a9c3-f14a10e77a50 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:21.844580 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8740233f-bc67-4968-a9c3-f14a10e77a50 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:21.990331 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-8740233f-bc67-4968-a9c3-f14a10e77a50 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:21.998359 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-8740233f-bc67-4968-a9c3-f14a10e77a50 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1358 microversion: 2.1 time: 0.168846 May 25 16:29:22.008050 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 473/937] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:21 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:22.204691 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-6d2ae006-4eef-4e7d-b878-84e6a0b83be2 req-c512808b-82df-4ebb-bca4-5b9e06a084a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11516011-7294-415c-9637-27fe37077315", "tag": "0bc5d294-6526-41f2-a874-eb5b98d8279f"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:29:22.213055 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-6d2ae006-4eef-4e7d-b878-84e6a0b83be2 req-c512808b-82df-4ebb-bca4-5b9e06a084a6 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:22.213509 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-6d2ae006-4eef-4e7d-b878-84e6a0b83be2 req-c512808b-82df-4ebb-bca4-5b9e06a084a6 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:22.227211 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-6d2ae006-4eef-4e7d-b878-84e6a0b83be2 req-c512808b-82df-4ebb-bca4-5b9e06a084a6 service nova] Creating event network-changed:0bc5d294-6526-41f2-a874-eb5b98d8279f for instance 11516011-7294-415c-9637-27fe37077315 on hv-cinder-84327 May 25 16:29:22.232576 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-6d2ae006-4eef-4e7d-b878-84e6a0b83be2 req-c512808b-82df-4ebb-bca4-5b9e06a084a6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032799 May 25 16:29:22.233172 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 465/938] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:29:22.447227 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-17291c55-1dd1-4a8e-b5ab-32463b61eca4 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:22.447837 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-17291c55-1dd1-4a8e-b5ab-32463b61eca4 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] [instance: a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:22.454517 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-17291c55-1dd1-4a8e-b5ab-32463b61eca4 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:22.454905 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-17291c55-1dd1-4a8e-b5ab-32463b61eca4 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:22.455659 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-17291c55-1dd1-4a8e-b5ab-32463b61eca4 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:22.456097 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-17291c55-1dd1-4a8e-b5ab-32463b61eca4 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:22.592032 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-17291c55-1dd1-4a8e-b5ab-32463b61eca4 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e791d332947bd88631e5e84b38669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77ca289b79f4074b17d3333288108e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:22.599566 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-17291c55-1dd1-4a8e-b5ab-32463b61eca4 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] 10.222.0.42 "GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f" status: 200 len: 1471 microversion: 2.1 time: 0.156189 May 25 16:29:22.600126 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 474/939] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:22 2022] GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:23.017291 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-15f763ac-6852-409c-9dc8-316feadfb3c2 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:23.018241 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-15f763ac-6852-409c-9dc8-316feadfb3c2 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:23.024819 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-15f763ac-6852-409c-9dc8-316feadfb3c2 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:23.025353 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-15f763ac-6852-409c-9dc8-316feadfb3c2 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:23.026232 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-15f763ac-6852-409c-9dc8-316feadfb3c2 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:23.027424 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-15f763ac-6852-409c-9dc8-316feadfb3c2 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:23.046543 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=100 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:29:23.160375 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-15f763ac-6852-409c-9dc8-316feadfb3c2 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:23.168059 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-15f763ac-6852-409c-9dc8-316feadfb3c2 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1358 microversion: 2.1 time: 0.155724 May 25 16:29:23.168614 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 466/940] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:23 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:23.618551 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-70bb5620-ee30-4bbd-b524-74e6756bf4a5 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:23.619672 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-70bb5620-ee30-4bbd-b524-74e6756bf4a5 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] [instance: a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:23.628404 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-70bb5620-ee30-4bbd-b524-74e6756bf4a5 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:23.628855 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-70bb5620-ee30-4bbd-b524-74e6756bf4a5 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:23.629619 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-70bb5620-ee30-4bbd-b524-74e6756bf4a5 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:23.630091 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-70bb5620-ee30-4bbd-b524-74e6756bf4a5 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:23.706231 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-70bb5620-ee30-4bbd-b524-74e6756bf4a5 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e791d332947bd88631e5e84b38669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77ca289b79f4074b17d3333288108e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:23.715401 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-70bb5620-ee30-4bbd-b524-74e6756bf4a5 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] 10.222.0.42 "GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f" status: 200 len: 1429 microversion: 2.1 time: 0.101427 May 25 16:29:23.715991 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 475/941] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:23 2022] GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f => generated 1429 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:24.184319 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-389dd6e3-1d8e-49c4-bff6-eb8b05a7c140 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:24.184925 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-389dd6e3-1d8e-49c4-bff6-eb8b05a7c140 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:24.191696 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-389dd6e3-1d8e-49c4-bff6-eb8b05a7c140 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:24.192280 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-389dd6e3-1d8e-49c4-bff6-eb8b05a7c140 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:24.193050 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-389dd6e3-1d8e-49c4-bff6-eb8b05a7c140 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:24.193526 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-389dd6e3-1d8e-49c4-bff6-eb8b05a7c140 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:24.247381 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-f0c714d0-bb86-43cd-a5d7-008ad6d82acf req-fbab5cdf-6983-4598-a96f-c0579c80e17c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f", "name": "network-vif-deleted", "tag": "6bf0f2f7-c219-4be5-a699-34ed7b6a97c7"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:29:24.256714 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-f0c714d0-bb86-43cd-a5d7-008ad6d82acf req-fbab5cdf-6983-4598-a96f-c0579c80e17c service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:24.257385 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-f0c714d0-bb86-43cd-a5d7-008ad6d82acf req-fbab5cdf-6983-4598-a96f-c0579c80e17c service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:24.268493 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-f0c714d0-bb86-43cd-a5d7-008ad6d82acf req-fbab5cdf-6983-4598-a96f-c0579c80e17c service nova] Creating event network-vif-deleted:6bf0f2f7-c219-4be5-a699-34ed7b6a97c7 for instance a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f on hv-cinder-84327 May 25 16:29:24.273559 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-f0c714d0-bb86-43cd-a5d7-008ad6d82acf req-fbab5cdf-6983-4598-a96f-c0579c80e17c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029816 May 25 16:29:24.274180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 476/942] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:29:24.323079 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-389dd6e3-1d8e-49c4-bff6-eb8b05a7c140 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:24.330592 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-389dd6e3-1d8e-49c4-bff6-eb8b05a7c140 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1358 microversion: 2.1 time: 0.150003 May 25 16:29:24.331198 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 467/943] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:24 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:24.733496 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-5f79ab8e-575d-4e58-8dbe-8e0722409c13 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:24.734220 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-5f79ab8e-575d-4e58-8dbe-8e0722409c13 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] [instance: a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:24.740408 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5f79ab8e-575d-4e58-8dbe-8e0722409c13 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:24.740854 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5f79ab8e-575d-4e58-8dbe-8e0722409c13 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:24.741603 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5f79ab8e-575d-4e58-8dbe-8e0722409c13 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:24.742059 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5f79ab8e-575d-4e58-8dbe-8e0722409c13 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:24.807319 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-5f79ab8e-575d-4e58-8dbe-8e0722409c13 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e791d332947bd88631e5e84b38669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77ca289b79f4074b17d3333288108e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:24.816391 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-5f79ab8e-575d-4e58-8dbe-8e0722409c13 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] 10.222.0.42 "GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f" status: 200 len: 1300 microversion: 2.1 time: 0.087635 May 25 16:29:24.817191 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 477/944] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:24 2022] GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f => generated 1300 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:25.347275 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-2f105fc6-6adb-4170-a5a2-c682e02b8d5d tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:25.347882 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-2f105fc6-6adb-4170-a5a2-c682e02b8d5d tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:25.354444 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2f105fc6-6adb-4170-a5a2-c682e02b8d5d tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:25.355438 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2f105fc6-6adb-4170-a5a2-c682e02b8d5d tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:25.356327 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2f105fc6-6adb-4170-a5a2-c682e02b8d5d tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:25.356770 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2f105fc6-6adb-4170-a5a2-c682e02b8d5d tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:25.496198 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-2f105fc6-6adb-4170-a5a2-c682e02b8d5d tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:25.504955 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-2f105fc6-6adb-4170-a5a2-c682e02b8d5d tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1358 microversion: 2.1 time: 0.161603 May 25 16:29:25.505926 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 468/945] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:25 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:25.835170 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-4b747f9b-7f98-4afd-88f8-4874290ccbf8 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:25.835787 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-4b747f9b-7f98-4afd-88f8-4874290ccbf8 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] [instance: a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:25.844304 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4b747f9b-7f98-4afd-88f8-4874290ccbf8 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:25.844951 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4b747f9b-7f98-4afd-88f8-4874290ccbf8 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:25.845800 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4b747f9b-7f98-4afd-88f8-4874290ccbf8 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:25.846230 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4b747f9b-7f98-4afd-88f8-4874290ccbf8 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:25.865111 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.wsgi [None req-4b747f9b-7f98-4afd-88f8-4874290ccbf8 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] HTTP exception thrown: Instance a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f could not be found. May 25 16:29:25.868664 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-4b747f9b-7f98-4afd-88f8-4874290ccbf8 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Request method failure captured: May 25 16:29:25.868664 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f HTTP/1.1 May 25 16:29:25.868664 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:29:25.868664 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:29:25.868664 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:29:25.868664 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 0 May 25 16:29:25.868664 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:29:25.868664 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:29:25.868664 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:29:25.868664 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:29:25.868664 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijllG33SciQUChvEmgScXzbeCms3ksWzoyhH1UEUsvbXT5b3L-YnbTpzVDsItLJbGo7FKAskpmIAaf9Cyehex-f4a3WwX4gIEp44NrWJIfxGRjIMsCW8RSB33R8HmAo4oj4O_dut0Y7ysiyvHU1U8GnXBjpdaPzfeVbckJqRIKud2tzo May 25 16:29:25.868664 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:29:25.868664 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:29:25.868664 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:29:25.868664 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:29:25.868664 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:29:25.868664 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:29:25.868664 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: d77ca289b79f4074b17d3333288108e5 May 25 16:29:25.868664 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-VolumesNegativeTest-268864454 May 25 16:29:25.868664 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:29:25.868664 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:29:25.870452 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d77ca289b79f4074b17d3333288108e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d77ca289b79f4074b17d3333288108e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d77ca289b79f4074b17d3333288108e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d77ca289b79f4074b17d3333288108e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:29:25.870452 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-VolumesNegativeTest-268864454 May 25 16:29:25.870452 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: d77ca289b79f4074b17d3333288108e5 May 25 16:29:25.870452 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-VolumesNegativeTest-268864454 May 25 16:29:25.870452 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-VolumesNegativeTest-268864454-project May 25 16:29:25.870452 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:29:25.870452 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:29:25.870452 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: 779e791d332947bd88631e5e84b38669 May 25 16:29:25.870452 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-VolumesNegativeTest-268864454-project May 25 16:29:25.870452 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: > May 25 16:29:25.870452 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Instance a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f could not be found. May 25 16:29:25.870452 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'id': 'a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f'} May 25 16:29:25.871473 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:29:25.871473 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:29:25.871473 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:29:25.871473 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:29:25.871473 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:29:25.871473 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:29:25.871473 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:29:25.871473 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:29:25.871473 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:29:25.871473 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:29:25.871473 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f could not be found. May 25 16:29:25.871473 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:29:25.871473 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:29:25.871473 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:29:25.871473 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:29:25.871473 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:29:25.871473 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:29:25.871473 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:29:25.871473 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:29:25.871473 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:29:25.873053 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:29:25.873053 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:29:25.873053 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:29:25.873053 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:29:25.873053 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:29:25.873053 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:29:25.873053 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:29:25.873053 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f could not be found. May 25 16:29:25.873053 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:29:25.873053 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:29:25.873053 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:29:25.873053 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:29:25.873053 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:29:25.873053 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:29:25.873053 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:29:25.873053 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:29:25.873053 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f could not be found. May 25 16:29:25.873053 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:29:25.874747 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-4b747f9b-7f98-4afd-88f8-4874290ccbf8 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] Returning 404 to user: Instance a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f could not be found. {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:29:25.874747 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-4b747f9b-7f98-4afd-88f8-4874290ccbf8 tempest-VolumesNegativeTest-268864454 tempest-VolumesNegativeTest-268864454-project] 10.222.0.42 "GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f" status: 404 len: 111 microversion: 2.1 time: 0.039529 May 25 16:29:25.874747 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 478/946] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:25 2022] GET /compute/v2.1/servers/a1cc3e41-bd5c-4470-a1d4-7dac1e1a824f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:29:26.522912 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-a551bf69-18aa-418b-b412-defad83f8111 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:26.523698 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-a551bf69-18aa-418b-b412-defad83f8111 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:26.532366 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a551bf69-18aa-418b-b412-defad83f8111 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:26.532829 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a551bf69-18aa-418b-b412-defad83f8111 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:26.533736 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a551bf69-18aa-418b-b412-defad83f8111 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:26.534229 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a551bf69-18aa-418b-b412-defad83f8111 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:26.678335 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-a551bf69-18aa-418b-b412-defad83f8111 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:26.690684 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-a551bf69-18aa-418b-b412-defad83f8111 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1358 microversion: 2.1 time: 0.171846 May 25 16:29:26.692162 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 469/947] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:26 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:27.708505 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-dd7ed0ac-6e90-43da-8d0d-00c5b07e2abf tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:27.709093 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-dd7ed0ac-6e90-43da-8d0d-00c5b07e2abf tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:27.711732 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:29:27.718673 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dd7ed0ac-6e90-43da-8d0d-00c5b07e2abf tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:27.719117 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dd7ed0ac-6e90-43da-8d0d-00c5b07e2abf tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:27.719896 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dd7ed0ac-6e90-43da-8d0d-00c5b07e2abf tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:27.720329 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-dd7ed0ac-6e90-43da-8d0d-00c5b07e2abf tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:27.860516 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-dd7ed0ac-6e90-43da-8d0d-00c5b07e2abf tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:27.868382 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-dd7ed0ac-6e90-43da-8d0d-00c5b07e2abf tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1358 microversion: 2.1 time: 0.163759 May 25 16:29:27.868941 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 479/948] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:27 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:28.530525 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-2514accf-bfc9-411d-bc69-54471c23bacd req-1c17e427-aff3-4d63-b8ce-9af9939171b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11516011-7294-415c-9637-27fe37077315", "name": "network-vif-plugged", "status": "completed", "tag": "0bc5d294-6526-41f2-a874-eb5b98d8279f"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:29:28.536777 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:29:28.545633 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-2514accf-bfc9-411d-bc69-54471c23bacd req-1c17e427-aff3-4d63-b8ce-9af9939171b0 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:28.546357 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-2514accf-bfc9-411d-bc69-54471c23bacd req-1c17e427-aff3-4d63-b8ce-9af9939171b0 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:28.560084 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-2514accf-bfc9-411d-bc69-54471c23bacd req-1c17e427-aff3-4d63-b8ce-9af9939171b0 service nova] Creating event network-vif-plugged:0bc5d294-6526-41f2-a874-eb5b98d8279f for instance 11516011-7294-415c-9637-27fe37077315 on hv-cinder-84327 May 25 16:29:28.565788 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-2514accf-bfc9-411d-bc69-54471c23bacd req-1c17e427-aff3-4d63-b8ce-9af9939171b0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039699 May 25 16:29:28.566631 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 470/949] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:29:28.885364 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-e5d14415-9e71-4021-981f-a315b8a66e91 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:28.886532 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-e5d14415-9e71-4021-981f-a315b8a66e91 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:28.893468 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e5d14415-9e71-4021-981f-a315b8a66e91 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:28.893956 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e5d14415-9e71-4021-981f-a315b8a66e91 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:28.894725 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e5d14415-9e71-4021-981f-a315b8a66e91 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:28.895164 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e5d14415-9e71-4021-981f-a315b8a66e91 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:29.035307 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-e5d14415-9e71-4021-981f-a315b8a66e91 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:29.043586 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-e5d14415-9e71-4021-981f-a315b8a66e91 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1358 microversion: 2.1 time: 0.161990 May 25 16:29:29.044131 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 480/950] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:28 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:30.061205 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-fc335129-1c29-4804-88cd-c7f874b472d1 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:30.062151 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-fc335129-1c29-4804-88cd-c7f874b472d1 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:30.069470 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-fc335129-1c29-4804-88cd-c7f874b472d1 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:30.069950 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-fc335129-1c29-4804-88cd-c7f874b472d1 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:30.070711 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-fc335129-1c29-4804-88cd-c7f874b472d1 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:30.071144 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-fc335129-1c29-4804-88cd-c7f874b472d1 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:30.238584 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-fc335129-1c29-4804-88cd-c7f874b472d1 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:30.248671 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-fc335129-1c29-4804-88cd-c7f874b472d1 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1358 microversion: 2.1 time: 0.192070 May 25 16:29:30.249251 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 471/951] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:30 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:31.267269 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-202f70cb-7273-48fd-bd0a-0bba316a8e76 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:31.268429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-202f70cb-7273-48fd-bd0a-0bba316a8e76 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:31.275316 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-202f70cb-7273-48fd-bd0a-0bba316a8e76 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:31.275775 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-202f70cb-7273-48fd-bd0a-0bba316a8e76 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:31.276804 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-202f70cb-7273-48fd-bd0a-0bba316a8e76 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:31.277511 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-202f70cb-7273-48fd-bd0a-0bba316a8e76 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:31.438215 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-202f70cb-7273-48fd-bd0a-0bba316a8e76 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:31.446761 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-202f70cb-7273-48fd-bd0a-0bba316a8e76 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1548 microversion: 2.1 time: 0.183363 May 25 16:29:31.450923 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 481/952] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:31 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1548 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:31.466987 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-bb319933-315f-4b84-ac41-7386bfee4970 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:31.467770 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-bb319933-315f-4b84-ac41-7386bfee4970 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:31.475049 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-bb319933-315f-4b84-ac41-7386bfee4970 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:31.475501 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-bb319933-315f-4b84-ac41-7386bfee4970 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:31.476276 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-bb319933-315f-4b84-ac41-7386bfee4970 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:31.476876 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-bb319933-315f-4b84-ac41-7386bfee4970 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:31.630207 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-bb319933-315f-4b84-ac41-7386bfee4970 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:31.638363 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-bb319933-315f-4b84-ac41-7386bfee4970 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1548 microversion: 2.1 time: 0.175817 May 25 16:29:31.638990 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 472/953] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:31 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1548 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:31.655136 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-ca342bc5-b4ec-49bc-93aa-fd8f6305b583 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:31.658796 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-ca342bc5-b4ec-49bc-93aa-fd8f6305b583 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:31.659958 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-ca342bc5-b4ec-49bc-93aa-fd8f6305b583 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Searching by: {'deleted': False, 'project_id': 'c8efc0621a1242329970cda13b3fee4b'} {{(pid=117509) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 25 16:29:31.669176 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ca342bc5-b4ec-49bc-93aa-fd8f6305b583 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:31.669625 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ca342bc5-b4ec-49bc-93aa-fd8f6305b583 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:31.670461 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ca342bc5-b4ec-49bc-93aa-fd8f6305b583 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:31.671043 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-ca342bc5-b4ec-49bc-93aa-fd8f6305b583 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:31.779722 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.multi_cell_list [None req-ca342bc5-b4ec-49bc-93aa-fd8f6305b583 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117509) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 25 16:29:31.880403 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-ca342bc5-b4ec-49bc-93aa-fd8f6305b583 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.229462 May 25 16:29:31.881311 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 482/954] 10.222.0.42 () {58 vars in 1124 bytes} [Wed May 25 16:29:31 2022] GET /compute/v2.1/servers => generated 343 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:29:31.892050 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-9139d150-a4eb-48c8-9dd9-629cf9b88a19 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:31.893607 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-9139d150-a4eb-48c8-9dd9-629cf9b88a19 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:31.903769 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9139d150-a4eb-48c8-9dd9-629cf9b88a19 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:31.904158 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9139d150-a4eb-48c8-9dd9-629cf9b88a19 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:31.904991 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9139d150-a4eb-48c8-9dd9-629cf9b88a19 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:31.905525 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9139d150-a4eb-48c8-9dd9-629cf9b88a19 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:32.043539 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-9139d150-a4eb-48c8-9dd9-629cf9b88a19 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:32.051039 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-9139d150-a4eb-48c8-9dd9-629cf9b88a19 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1548 microversion: 2.1 time: 0.163012 May 25 16:29:32.051607 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 473/955] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:31 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:33.344147 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-72479f37-b374-407c-8ae3-02ad800f1963 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1329982835", "imageRef": "e74cccc1-cd1b-4dfc-8e47-3e4a832649a8", "flavorRef": "452", "networks": [{"uuid": "81d635de-5dd6-41b5-944e-480323c72862"}]}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:29:33.395475 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.network.neutron [None req-72479f37-b374-407c-8ae3-02ad800f1963 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] validate_networks() for [('81d635de-5dd6-41b5-944e-480323c72862', None, None, None, None, None)] {{(pid=117509) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:29:33.602947 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-92635bc8-bcb8-4902-94c3-445e8511fc54 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04bce330-9df3-4db3-9333-93843f848820"}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:29:33.604122 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-92635bc8-bcb8-4902-94c3-445e8511fc54 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:33.611188 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-92635bc8-bcb8-4902-94c3-445e8511fc54 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:33.611639 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-92635bc8-bcb8-4902-94c3-445e8511fc54 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:33.612410 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-92635bc8-bcb8-4902-94c3-445e8511fc54 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:33.612849 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-92635bc8-bcb8-4902-94c3-445e8511fc54 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:33.735452 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-72479f37-b374-407c-8ae3-02ad800f1963 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Flavor limits 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:29:33.735869 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-72479f37-b374-407c-8ae3-02ad800f1963 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Image limits 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:29:33.736343 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-72479f37-b374-407c-8ae3-02ad800f1963 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Flavor pref 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:29:33.736766 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-72479f37-b374-407c-8ae3-02ad800f1963 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Image pref 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:29:33.737176 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-72479f37-b374-407c-8ae3-02ad800f1963 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:29:33.750298 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-72479f37-b374-407c-8ae3-02ad800f1963 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:33.750744 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-72479f37-b374-407c-8ae3-02ad800f1963 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:33.751532 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-72479f37-b374-407c-8ae3-02ad800f1963 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:33.751985 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-72479f37-b374-407c-8ae3-02ad800f1963 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:33.772229 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-72479f37-b374-407c-8ae3-02ad800f1963 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Getting quotas for project 9f6a5a6ae8b2488f8a5af6d2066fa88e. Resources: {'ram', 'cores', 'instances'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:29:33.776137 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-72479f37-b374-407c-8ae3-02ad800f1963 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Getting quotas for user 28d0cf08accf4a28b85ac2342d9c3023 and project 9f6a5a6ae8b2488f8a5af6d2066fa88e. Resources: {'ram', 'cores', 'instances'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:29:33.788315 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-72479f37-b374-407c-8ae3-02ad800f1963 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Going to run 1 instances... {{(pid=117509) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:29:33.791559 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-72479f37-b374-407c-8ae3-02ad800f1963 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: ea7289e9-fc54-4ad9-b784-32751344f97d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e74cccc1-cd1b-4dfc-8e47-3e4a832649a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:29:33.838579 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-72479f37-b374-407c-8ae3-02ad800f1963 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498369 May 25 16:29:33.845498 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 483/956] 10.222.0.42 () {60 vars in 1146 bytes} [Wed May 25 16:29:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:29:33.850507 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-12ae6455-02ec-4a03-b34e-a6a275cb368f tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:33.851327 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-12ae6455-02ec-4a03-b34e-a6a275cb368f tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: ea7289e9-fc54-4ad9-b784-32751344f97d] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:33.890500 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-92635bc8-bcb8-4902-94c3-445e8511fc54 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "POST /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289924 May 25 16:29:33.892060 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 474/957] 10.222.0.42 () {60 vars in 1322 bytes} [Wed May 25 16:29:33 2022] POST /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:29:33.956404 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-12ae6455-02ec-4a03-b34e-a6a275cb368f tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d0cf08accf4a28b85ac2342d9c3023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6a5a6ae8b2488f8a5af6d2066fa88e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:33.966651 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-12ae6455-02ec-4a03-b34e-a6a275cb368f tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "GET /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d" status: 200 len: 1219 microversion: 2.1 time: 0.118923 May 25 16:29:33.974653 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 484/958] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:33 2022] GET /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d => generated 1219 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:34.989889 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-52d2f75b-1a4c-409d-b44a-10e49ad960b8 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:34.990448 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-52d2f75b-1a4c-409d-b44a-10e49ad960b8 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: ea7289e9-fc54-4ad9-b784-32751344f97d] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:35.018482 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-52d2f75b-1a4c-409d-b44a-10e49ad960b8 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:35.019760 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-52d2f75b-1a4c-409d-b44a-10e49ad960b8 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:35.020593 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-52d2f75b-1a4c-409d-b44a-10e49ad960b8 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:35.021041 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-52d2f75b-1a4c-409d-b44a-10e49ad960b8 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:35.138098 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-52d2f75b-1a4c-409d-b44a-10e49ad960b8 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d0cf08accf4a28b85ac2342d9c3023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6a5a6ae8b2488f8a5af6d2066fa88e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:35.147330 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-52d2f75b-1a4c-409d-b44a-10e49ad960b8 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "GET /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d" status: 200 len: 1277 microversion: 2.1 time: 0.162420 May 25 16:29:35.148435 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 475/959] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:34 2022] GET /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:36.166344 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-02697de0-cebc-4799-99d0-85a7027aab42 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:36.167077 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-02697de0-cebc-4799-99d0-85a7027aab42 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: ea7289e9-fc54-4ad9-b784-32751344f97d] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:36.174147 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-02697de0-cebc-4799-99d0-85a7027aab42 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:36.175015 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-02697de0-cebc-4799-99d0-85a7027aab42 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:36.175790 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-02697de0-cebc-4799-99d0-85a7027aab42 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:36.176252 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-02697de0-cebc-4799-99d0-85a7027aab42 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:36.257014 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-bacac2c2-64a3-437b-abcf-dd62364b61f6 req-06bae51f-245d-4392-be87-3fe8ef4f647a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea7289e9-fc54-4ad9-b784-32751344f97d", "tag": "a7812a9c-7d68-49af-838a-93144c04d0d3"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:29:36.268850 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-bacac2c2-64a3-437b-abcf-dd62364b61f6 req-06bae51f-245d-4392-be87-3fe8ef4f647a service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:36.269286 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-bacac2c2-64a3-437b-abcf-dd62364b61f6 req-06bae51f-245d-4392-be87-3fe8ef4f647a service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:36.286771 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-bacac2c2-64a3-437b-abcf-dd62364b61f6 req-06bae51f-245d-4392-be87-3fe8ef4f647a service nova] Creating event network-changed:a7812a9c-7d68-49af-838a-93144c04d0d3 for instance ea7289e9-fc54-4ad9-b784-32751344f97d on hv-cinder-84327 May 25 16:29:36.292561 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-bacac2c2-64a3-437b-abcf-dd62364b61f6 req-06bae51f-245d-4392-be87-3fe8ef4f647a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039235 May 25 16:29:36.294171 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 476/960] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:29:36.333394 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-02697de0-cebc-4799-99d0-85a7027aab42 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d0cf08accf4a28b85ac2342d9c3023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6a5a6ae8b2488f8a5af6d2066fa88e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:36.341658 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-02697de0-cebc-4799-99d0-85a7027aab42 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "GET /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d" status: 200 len: 1319 microversion: 2.1 time: 0.180248 May 25 16:29:36.342248 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 485/961] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:36 2022] GET /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:37.362042 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-3bc38a9b-31f4-4726-b46e-1a9efc9ad8ff tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:37.362729 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-3bc38a9b-31f4-4726-b46e-1a9efc9ad8ff tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: ea7289e9-fc54-4ad9-b784-32751344f97d] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:37.369104 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3bc38a9b-31f4-4726-b46e-1a9efc9ad8ff tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:37.369543 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3bc38a9b-31f4-4726-b46e-1a9efc9ad8ff tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:37.370331 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3bc38a9b-31f4-4726-b46e-1a9efc9ad8ff tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:37.370762 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3bc38a9b-31f4-4726-b46e-1a9efc9ad8ff tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:37.579356 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-3bc38a9b-31f4-4726-b46e-1a9efc9ad8ff tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d0cf08accf4a28b85ac2342d9c3023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6a5a6ae8b2488f8a5af6d2066fa88e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:37.587471 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-3bc38a9b-31f4-4726-b46e-1a9efc9ad8ff tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "GET /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d" status: 200 len: 1319 microversion: 2.1 time: 0.231135 May 25 16:29:37.588051 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 477/962] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:37 2022] GET /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:38.606863 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-b4dd86c8-cb53-45fb-ac6e-91c522ff8b43 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:38.609032 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-b4dd86c8-cb53-45fb-ac6e-91c522ff8b43 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: ea7289e9-fc54-4ad9-b784-32751344f97d] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:38.615246 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b4dd86c8-cb53-45fb-ac6e-91c522ff8b43 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:38.615686 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b4dd86c8-cb53-45fb-ac6e-91c522ff8b43 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:38.616487 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b4dd86c8-cb53-45fb-ac6e-91c522ff8b43 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:38.616906 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b4dd86c8-cb53-45fb-ac6e-91c522ff8b43 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:38.852801 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-b4dd86c8-cb53-45fb-ac6e-91c522ff8b43 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d0cf08accf4a28b85ac2342d9c3023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6a5a6ae8b2488f8a5af6d2066fa88e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:38.860823 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-b4dd86c8-cb53-45fb-ac6e-91c522ff8b43 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "GET /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d" status: 200 len: 1319 microversion: 2.1 time: 0.259612 May 25 16:29:38.861396 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 486/963] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:38 2022] GET /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:39.879339 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-1a308657-c21d-4d5c-b2a2-1e079b39d909 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:39.880663 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-1a308657-c21d-4d5c-b2a2-1e079b39d909 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: ea7289e9-fc54-4ad9-b784-32751344f97d] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:39.889599 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1a308657-c21d-4d5c-b2a2-1e079b39d909 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:39.890392 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1a308657-c21d-4d5c-b2a2-1e079b39d909 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:39.892179 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1a308657-c21d-4d5c-b2a2-1e079b39d909 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:39.892839 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1a308657-c21d-4d5c-b2a2-1e079b39d909 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:40.066636 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-1a308657-c21d-4d5c-b2a2-1e079b39d909 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d0cf08accf4a28b85ac2342d9c3023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6a5a6ae8b2488f8a5af6d2066fa88e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:40.075154 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-1a308657-c21d-4d5c-b2a2-1e079b39d909 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "GET /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d" status: 200 len: 1319 microversion: 2.1 time: 0.200682 May 25 16:29:40.075878 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 478/964] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:39 2022] GET /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:41.093062 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-bb4f6448-8834-41fd-a9a4-011101831a19 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:41.093666 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-bb4f6448-8834-41fd-a9a4-011101831a19 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: ea7289e9-fc54-4ad9-b784-32751344f97d] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:41.104175 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-bb4f6448-8834-41fd-a9a4-011101831a19 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:41.104870 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-bb4f6448-8834-41fd-a9a4-011101831a19 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:41.105839 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-bb4f6448-8834-41fd-a9a4-011101831a19 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:41.106434 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-bb4f6448-8834-41fd-a9a4-011101831a19 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:41.297025 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-bb4f6448-8834-41fd-a9a4-011101831a19 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d0cf08accf4a28b85ac2342d9c3023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6a5a6ae8b2488f8a5af6d2066fa88e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:41.305065 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-bb4f6448-8834-41fd-a9a4-011101831a19 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "GET /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d" status: 200 len: 1319 microversion: 2.1 time: 0.216413 May 25 16:29:41.305565 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 487/965] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:41 2022] GET /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:41.614129 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-949ec123-022d-4f86-920b-1dad2df76162 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:41.614732 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-949ec123-022d-4f86-920b-1dad2df76162 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:41.621863 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-949ec123-022d-4f86-920b-1dad2df76162 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:41.622306 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-949ec123-022d-4f86-920b-1dad2df76162 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:41.623388 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-949ec123-022d-4f86-920b-1dad2df76162 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:41.623994 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-949ec123-022d-4f86-920b-1dad2df76162 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:41.776179 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-949ec123-022d-4f86-920b-1dad2df76162 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:41.784739 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-949ec123-022d-4f86-920b-1dad2df76162 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1594 microversion: 2.1 time: 0.174342 May 25 16:29:41.797748 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 479/966] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:41 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1594 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:42.322574 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-2f853984-7a61-42fc-8396-a8c3d02dc211 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:42.323142 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-2f853984-7a61-42fc-8396-a8c3d02dc211 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: ea7289e9-fc54-4ad9-b784-32751344f97d] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:42.332965 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2f853984-7a61-42fc-8396-a8c3d02dc211 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:42.334093 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2f853984-7a61-42fc-8396-a8c3d02dc211 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:42.335542 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2f853984-7a61-42fc-8396-a8c3d02dc211 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:42.336469 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2f853984-7a61-42fc-8396-a8c3d02dc211 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:42.670138 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-2f853984-7a61-42fc-8396-a8c3d02dc211 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d0cf08accf4a28b85ac2342d9c3023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6a5a6ae8b2488f8a5af6d2066fa88e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:42.680830 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-2f853984-7a61-42fc-8396-a8c3d02dc211 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "GET /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d" status: 200 len: 1319 microversion: 2.1 time: 0.362167 May 25 16:29:42.682111 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 488/967] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:42 2022] GET /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d => generated 1319 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:42.766089 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-e4baad41-0579-426d-9769-a6aa0df097b8 req-654fd547-0b62-420f-ad98-8c0132f15a9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea7289e9-fc54-4ad9-b784-32751344f97d", "name": "network-vif-plugged", "status": "completed", "tag": "a7812a9c-7d68-49af-838a-93144c04d0d3"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:29:42.798053 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-e4baad41-0579-426d-9769-a6aa0df097b8 req-654fd547-0b62-420f-ad98-8c0132f15a9a service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:42.799116 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-e4baad41-0579-426d-9769-a6aa0df097b8 req-654fd547-0b62-420f-ad98-8c0132f15a9a service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:42.820736 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-e4baad41-0579-426d-9769-a6aa0df097b8 req-654fd547-0b62-420f-ad98-8c0132f15a9a service nova] Creating event network-vif-plugged:a7812a9c-7d68-49af-838a-93144c04d0d3 for instance ea7289e9-fc54-4ad9-b784-32751344f97d on hv-cinder-84327 May 25 16:29:42.829598 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-e4baad41-0579-426d-9769-a6aa0df097b8 req-654fd547-0b62-420f-ad98-8c0132f15a9a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069323 May 25 16:29:42.831194 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 480/968] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:29:43.707293 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-2fc0e92f-1170-40ab-b334-90c771b5f6dc tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:43.709206 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-2fc0e92f-1170-40ab-b334-90c771b5f6dc tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: ea7289e9-fc54-4ad9-b784-32751344f97d] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:43.721835 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2fc0e92f-1170-40ab-b334-90c771b5f6dc tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:43.723061 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2fc0e92f-1170-40ab-b334-90c771b5f6dc tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:43.724670 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2fc0e92f-1170-40ab-b334-90c771b5f6dc tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:43.725748 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2fc0e92f-1170-40ab-b334-90c771b5f6dc tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:43.766559 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell0:SELECT=4 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:29:43.963211 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell0:SELECT=8 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:29:44.039330 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-2fc0e92f-1170-40ab-b334-90c771b5f6dc tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d0cf08accf4a28b85ac2342d9c3023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6a5a6ae8b2488f8a5af6d2066fa88e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:44.067660 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-2fc0e92f-1170-40ab-b334-90c771b5f6dc tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "GET /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d" status: 200 len: 1319 microversion: 2.1 time: 0.371369 May 25 16:29:44.068881 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 489/969] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:43 2022] GET /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d => generated 1319 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:44.804386 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-0709e3a5-e9e5-4936-9642-1c5fb3337a3c req-5156f993-b289-4d00-bd4e-c8484e6c5a5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11516011-7294-415c-9637-27fe37077315", "tag": "0bc5d294-6526-41f2-a874-eb5b98d8279f"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:29:44.824517 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-0709e3a5-e9e5-4936-9642-1c5fb3337a3c req-5156f993-b289-4d00-bd4e-c8484e6c5a5d service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:44.824987 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-0709e3a5-e9e5-4936-9642-1c5fb3337a3c req-5156f993-b289-4d00-bd4e-c8484e6c5a5d service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:44.868558 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-0709e3a5-e9e5-4936-9642-1c5fb3337a3c req-5156f993-b289-4d00-bd4e-c8484e6c5a5d service nova] Creating event network-changed:0bc5d294-6526-41f2-a874-eb5b98d8279f for instance 11516011-7294-415c-9637-27fe37077315 on hv-cinder-84327 May 25 16:29:44.886138 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-0709e3a5-e9e5-4936-9642-1c5fb3337a3c req-5156f993-b289-4d00-bd4e-c8484e6c5a5d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085286 May 25 16:29:44.887061 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 481/970] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:29:45.087794 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-d926b25a-ceaa-4fd4-8c64-234b119a0f3b tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:45.088278 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-d926b25a-ceaa-4fd4-8c64-234b119a0f3b tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: ea7289e9-fc54-4ad9-b784-32751344f97d] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:45.101940 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d926b25a-ceaa-4fd4-8c64-234b119a0f3b tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:45.103369 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d926b25a-ceaa-4fd4-8c64-234b119a0f3b tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:45.105400 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d926b25a-ceaa-4fd4-8c64-234b119a0f3b tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:45.106762 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d926b25a-ceaa-4fd4-8c64-234b119a0f3b tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:45.407391 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=100 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:29:45.673467 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-d926b25a-ceaa-4fd4-8c64-234b119a0f3b tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d0cf08accf4a28b85ac2342d9c3023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6a5a6ae8b2488f8a5af6d2066fa88e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:45.694125 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-d926b25a-ceaa-4fd4-8c64-234b119a0f3b tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "GET /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d" status: 200 len: 1507 microversion: 2.1 time: 0.597451 May 25 16:29:45.694831 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 490/971] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:45 2022] GET /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d => generated 1507 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:47.555543 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-e60a1182-140c-457a-89f6-4ccc7dcd2270 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-574722537"}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:29:47.556653 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-e60a1182-140c-457a-89f6-4ccc7dcd2270 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:47.573119 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e60a1182-140c-457a-89f6-4ccc7dcd2270 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:47.573875 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e60a1182-140c-457a-89f6-4ccc7dcd2270 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:47.574734 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e60a1182-140c-457a-89f6-4ccc7dcd2270 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:47.575192 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e60a1182-140c-457a-89f6-4ccc7dcd2270 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:47.848581 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.network.security_group_api [None req-e60a1182-140c-457a-89f6-4ccc7dcd2270 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Adding security group 112fb6f1-635e-4d28-bb0d-83a601a813d5 to port 0bc5d294-6526-41f2-a874-eb5b98d8279f May 25 16:29:48.867083 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-e60a1182-140c-457a-89f6-4ccc7dcd2270 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "POST /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315/action" status: 202 len: 0 microversion: 2.1 time: 1.315867 May 25 16:29:48.868138 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 482/972] 10.222.0.42 () {60 vars in 1277 bytes} [Wed May 25 16:29:47 2022] POST /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315/action => generated 0 bytes in 1318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 16:29:48.876440 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-fd220816-338c-4046-9b19-408cf9ca29bb req-c25ee1c5-9a90-4d8f-bc16-498d438999d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11516011-7294-415c-9637-27fe37077315", "tag": "0bc5d294-6526-41f2-a874-eb5b98d8279f"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:29:48.878144 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-d7ce4c9a-c3ea-4409-8933-a02e52809b94 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:29:48.892537 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-d7ce4c9a-c3ea-4409-8933-a02e52809b94 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:29:48.902810 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d7ce4c9a-c3ea-4409-8933-a02e52809b94 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:48.903455 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d7ce4c9a-c3ea-4409-8933-a02e52809b94 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:48.911854 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-fd220816-338c-4046-9b19-408cf9ca29bb req-c25ee1c5-9a90-4d8f-bc16-498d438999d2 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:48.913434 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-fd220816-338c-4046-9b19-408cf9ca29bb req-c25ee1c5-9a90-4d8f-bc16-498d438999d2 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:48.914065 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d7ce4c9a-c3ea-4409-8933-a02e52809b94 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:29:48.914666 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d7ce4c9a-c3ea-4409-8933-a02e52809b94 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:29:48.949366 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-fd220816-338c-4046-9b19-408cf9ca29bb req-c25ee1c5-9a90-4d8f-bc16-498d438999d2 service nova] Creating event network-changed:0bc5d294-6526-41f2-a874-eb5b98d8279f for instance 11516011-7294-415c-9637-27fe37077315 on hv-cinder-84327 May 25 16:29:48.956942 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-fd220816-338c-4046-9b19-408cf9ca29bb req-c25ee1c5-9a90-4d8f-bc16-498d438999d2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084259 May 25 16:29:48.958391 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 483/973] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:29:49.474288 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-d7ce4c9a-c3ea-4409-8933-a02e52809b94 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:29:49.486012 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-d7ce4c9a-c3ea-4409-8933-a02e52809b94 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1759 microversion: 2.1 time: 0.613681 May 25 16:29:49.487166 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 491/974] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:29:48 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1759 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:29:50.090982 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-1a570b9e-9ac1-40d5-a1e2-0f410e91a69b tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Action: 'create', calling method: .version_select at 0x7f51ed8e7e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-1717979148", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUKCQ5Z88/perJ7PMKy1WlKjGU7ICXDAh6/jya6wF2b7/yrVDGPBFx/0GWSALej8y6MNWToFqSOHtBlgvDCPQRBVKL9w7Rz1qhKEkEu9Y8tpQJmapn0M70oacD+4kqoZQ=="}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:29:50.106178 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-1a570b9e-9ac1-40d5-a1e2-0f410e91a69b tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Getting quotas for project cfe6a9374c6d48e9933d6f099cc32bd2. Resources: {'key_pairs'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:29:50.110923 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-1a570b9e-9ac1-40d5-a1e2-0f410e91a69b tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Getting quotas for user 246d8b08525243c893175a0aff2dabff and project cfe6a9374c6d48e9933d6f099cc32bd2. Resources: {'key_pairs'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:29:50.135881 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-1a570b9e-9ac1-40d5-a1e2-0f410e91a69b tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.463761 May 25 16:29:50.136538 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 484/975] 10.222.0.42 () {60 vars in 1158 bytes} [Wed May 25 16:29:49 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:30:04.636561 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-0f36c7aa-4a94-4675-8c53-234116200f0e tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "204207b3-b4cf-4335-bdea-28eac8af979b", "device": "/dev/sdb"}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:30:04.638798 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-0f36c7aa-4a94-4675-8c53-234116200f0e tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: ea7289e9-fc54-4ad9-b784-32751344f97d] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:04.641231 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:30:04.641902 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=8 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:30:04.647604 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0f36c7aa-4a94-4675-8c53-234116200f0e tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:04.648050 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0f36c7aa-4a94-4675-8c53-234116200f0e tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:04.648812 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0f36c7aa-4a94-4675-8c53-234116200f0e tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:04.649246 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0f36c7aa-4a94-4675-8c53-234116200f0e tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:04.919581 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-0f36c7aa-4a94-4675-8c53-234116200f0e tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "POST /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286668 May 25 16:30:04.920400 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 492/976] 10.222.0.42 () {60 vars in 1322 bytes} [Wed May 25 16:30:04 2022] POST /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:30:10.472644 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-021c6971-9161-4f60-9510-c3878afbed71 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1788026077", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1717979148", "security_groups": [{"name": "tempest-secgroup-smoke-1193139595"}], "networks": [{"uuid": "ec5189c6-06ee-4305-8134-5b85eed97686"}], "block_device_mapping_v2": [{"uuid": "fcd66961-b6f2-4ba6-84ef-fcd5b77e4654", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:30:10.481144 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:30:10.482643 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell0:SELECT=4 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:30:10.483797 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:30:10.648879 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.network.neutron [None req-021c6971-9161-4f60-9510-c3878afbed71 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] validate_networks() for [('ec5189c6-06ee-4305-8134-5b85eed97686', None, None, None, None, None)] {{(pid=117510) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:30:11.550306 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-021c6971-9161-4f60-9510-c3878afbed71 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Flavor limits 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:30:11.550910 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-021c6971-9161-4f60-9510-c3878afbed71 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Image limits 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:30:11.551208 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-021c6971-9161-4f60-9510-c3878afbed71 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Flavor pref 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:30:11.551636 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-021c6971-9161-4f60-9510-c3878afbed71 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Image pref 0:0:0 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:30:11.552062 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.virt.hardware [None req-021c6971-9161-4f60-9510-c3878afbed71 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:30:11.560990 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-021c6971-9161-4f60-9510-c3878afbed71 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:11.561441 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-021c6971-9161-4f60-9510-c3878afbed71 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:11.562534 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-021c6971-9161-4f60-9510-c3878afbed71 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:11.562973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-021c6971-9161-4f60-9510-c3878afbed71 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:11.580622 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-021c6971-9161-4f60-9510-c3878afbed71 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Getting quotas for project cfe6a9374c6d48e9933d6f099cc32bd2. Resources: {'ram', 'cores', 'instances'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:30:11.585142 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.quota [None req-021c6971-9161-4f60-9510-c3878afbed71 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Getting quotas for user 246d8b08525243c893175a0aff2dabff and project cfe6a9374c6d48e9933d6f099cc32bd2. Resources: {'ram', 'cores', 'instances'} {{(pid=117510) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:30:11.645485 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-021c6971-9161-4f60-9510-c3878afbed71 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Going to run 1 instances... {{(pid=117510) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:30:11.647717 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-021c6971-9161-4f60-9510-c3878afbed71 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fcd66961-b6f2-4ba6-84ef-fcd5b77e4654',volume_size=None,volume_type=None)] {{(pid=117510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:30:11.708024 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-afecbc31-39e9-4cf3-b071-00e919b96743 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:11.708611 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-afecbc31-39e9-4cf3-b071-00e919b96743 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: be25cf4d-733b-4999-b6d9-474da04a6444] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:11.719109 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-afecbc31-39e9-4cf3-b071-00e919b96743 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:11.719919 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-afecbc31-39e9-4cf3-b071-00e919b96743 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:11.720765 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-afecbc31-39e9-4cf3-b071-00e919b96743 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:11.721614 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-afecbc31-39e9-4cf3-b071-00e919b96743 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:11.748673 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-afecbc31-39e9-4cf3-b071-00e919b96743 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: be25cf4d-733b-4999-b6d9-474da04a6444] Going to try to terminate instance {{(pid=117509) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:30:11.819724 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-021c6971-9161-4f60-9510-c3878afbed71 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.351049 May 25 16:30:11.820751 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 485/977] 10.222.0.42 () {60 vars in 1146 bytes} [Wed May 25 16:30:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:30:11.826310 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-d1d483a5-50ac-4e67-90e2-af8fdc945ef6 req-b264237b-ea55-4d65-8a55-99ac6b5de241 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be25cf4d-733b-4999-b6d9-474da04a6444", "tag": "28e24d33-7178-4533-933f-ce0069b847bd"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:30:11.835729 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-d1d483a5-50ac-4e67-90e2-af8fdc945ef6 req-b264237b-ea55-4d65-8a55-99ac6b5de241 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:11.836237 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-d1d483a5-50ac-4e67-90e2-af8fdc945ef6 req-b264237b-ea55-4d65-8a55-99ac6b5de241 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:11.850218 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-d1d483a5-50ac-4e67-90e2-af8fdc945ef6 req-b264237b-ea55-4d65-8a55-99ac6b5de241 service nova] Creating event network-changed:28e24d33-7178-4533-933f-ce0069b847bd for instance be25cf4d-733b-4999-b6d9-474da04a6444 on hv-cinder-84327 May 25 16:30:11.857555 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-d1d483a5-50ac-4e67-90e2-af8fdc945ef6 req-b264237b-ea55-4d65-8a55-99ac6b5de241 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035037 May 25 16:30:11.858520 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 486/978] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:30:11.861618 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-afecbc31-39e9-4cf3-b071-00e919b96743 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "DELETE /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444" status: 204 len: 0 microversion: 2.1 time: 0.158484 May 25 16:30:11.865200 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 493/979] 10.222.0.42 () {58 vars in 1238 bytes} [Wed May 25 16:30:11 2022] DELETE /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 25 16:30:11.872109 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-454f78ad-ca72-49c6-83c0-eb94f3bd496a tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:11.873363 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-f72212f1-ca05-4986-9714-be3e7fd17cb7 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:11.873774 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-454f78ad-ca72-49c6-83c0-eb94f3bd496a tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:11.874271 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-f72212f1-ca05-4986-9714-be3e7fd17cb7 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: be25cf4d-733b-4999-b6d9-474da04a6444] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:11.883303 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f72212f1-ca05-4986-9714-be3e7fd17cb7 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:11.883844 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f72212f1-ca05-4986-9714-be3e7fd17cb7 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:11.884680 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f72212f1-ca05-4986-9714-be3e7fd17cb7 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:11.886094 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f72212f1-ca05-4986-9714-be3e7fd17cb7 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:11.950237 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-454f78ad-ca72-49c6-83c0-eb94f3bd496a tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:11.958207 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-454f78ad-ca72-49c6-83c0-eb94f3bd496a tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1089 microversion: 2.1 time: 0.098742 May 25 16:30:11.959429 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 487/980] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:11 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1089 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:12.056231 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-f72212f1-ca05-4986-9714-be3e7fd17cb7 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:12.066645 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-f72212f1-ca05-4986-9714-be3e7fd17cb7 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444" status: 200 len: 1576 microversion: 2.1 time: 0.199565 May 25 16:30:12.067789 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 494/981] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:11 2022] GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444 => generated 1576 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:12.110453 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-3cfe149c-afa8-4a46-b015-ea7956f71d46 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:30:12.111560 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-3cfe149c-afa8-4a46-b015-ea7956f71d46 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:12.118577 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3cfe149c-afa8-4a46-b015-ea7956f71d46 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:12.119180 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3cfe149c-afa8-4a46-b015-ea7956f71d46 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:12.120090 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3cfe149c-afa8-4a46-b015-ea7956f71d46 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:12.120664 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3cfe149c-afa8-4a46-b015-ea7956f71d46 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:12.204006 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-3cfe149c-afa8-4a46-b015-ea7956f71d46 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "POST /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315/action" status: 202 len: 0 microversion: 2.1 time: 0.097619 May 25 16:30:12.207740 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 488/982] 10.222.0.42 () {60 vars in 1277 bytes} [Wed May 25 16:30:12 2022] POST /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:30:12.212781 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-f482b5eb-184b-457e-b6ea-f8be6902a84f tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:12.214091 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-f482b5eb-184b-457e-b6ea-f8be6902a84f tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:12.221482 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f482b5eb-184b-457e-b6ea-f8be6902a84f tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:12.222124 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f482b5eb-184b-457e-b6ea-f8be6902a84f tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:12.222900 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f482b5eb-184b-457e-b6ea-f8be6902a84f tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:12.223334 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f482b5eb-184b-457e-b6ea-f8be6902a84f tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:12.377095 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-f482b5eb-184b-457e-b6ea-f8be6902a84f tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:12.386552 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-f482b5eb-184b-457e-b6ea-f8be6902a84f tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1751 microversion: 2.1 time: 0.177472 May 25 16:30:12.387268 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 495/983] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:12 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:12.975482 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-9670fae2-1996-4c3b-b5d3-45e0df904da4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:12.976172 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-9670fae2-1996-4c3b-b5d3-45e0df904da4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:12.983202 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9670fae2-1996-4c3b-b5d3-45e0df904da4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:12.983647 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9670fae2-1996-4c3b-b5d3-45e0df904da4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:12.984408 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9670fae2-1996-4c3b-b5d3-45e0df904da4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:12.984840 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9670fae2-1996-4c3b-b5d3-45e0df904da4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:13.046366 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-9670fae2-1996-4c3b-b5d3-45e0df904da4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:13.054947 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-9670fae2-1996-4c3b-b5d3-45e0df904da4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1139 microversion: 2.1 time: 0.083625 May 25 16:30:13.055532 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 489/984] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:12 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:13.086504 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-d9283433-ab9e-42f4-8e3d-2e26fc9791bb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:13.087112 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-d9283433-ab9e-42f4-8e3d-2e26fc9791bb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: be25cf4d-733b-4999-b6d9-474da04a6444] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:13.094491 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d9283433-ab9e-42f4-8e3d-2e26fc9791bb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:13.094944 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d9283433-ab9e-42f4-8e3d-2e26fc9791bb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:13.095731 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d9283433-ab9e-42f4-8e3d-2e26fc9791bb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:13.096170 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-d9283433-ab9e-42f4-8e3d-2e26fc9791bb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:13.226345 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-d9283433-ab9e-42f4-8e3d-2e26fc9791bb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:13.234014 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-d9283433-ab9e-42f4-8e3d-2e26fc9791bb tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444" status: 200 len: 1576 microversion: 2.1 time: 0.151406 May 25 16:30:13.234581 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 496/985] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:13 2022] GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:13.404788 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-e8d5d4c0-c14f-4d56-8cfa-1d6f159a4d27 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:13.405404 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-e8d5d4c0-c14f-4d56-8cfa-1d6f159a4d27 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:13.411410 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e8d5d4c0-c14f-4d56-8cfa-1d6f159a4d27 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:13.411864 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e8d5d4c0-c14f-4d56-8cfa-1d6f159a4d27 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:13.412633 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e8d5d4c0-c14f-4d56-8cfa-1d6f159a4d27 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:13.413073 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e8d5d4c0-c14f-4d56-8cfa-1d6f159a4d27 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:13.551995 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-e8d5d4c0-c14f-4d56-8cfa-1d6f159a4d27 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:13.560705 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-e8d5d4c0-c14f-4d56-8cfa-1d6f159a4d27 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1751 microversion: 2.1 time: 0.159404 May 25 16:30:13.561474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 490/986] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:13 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:14.072140 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-4446e272-2bf0-4d65-9df2-d5eda9285641 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:14.072667 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-4446e272-2bf0-4d65-9df2-d5eda9285641 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:14.078738 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4446e272-2bf0-4d65-9df2-d5eda9285641 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:14.079186 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4446e272-2bf0-4d65-9df2-d5eda9285641 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:14.079946 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4446e272-2bf0-4d65-9df2-d5eda9285641 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:14.080387 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4446e272-2bf0-4d65-9df2-d5eda9285641 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:14.144786 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-4446e272-2bf0-4d65-9df2-d5eda9285641 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:14.152128 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-4446e272-2bf0-4d65-9df2-d5eda9285641 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1139 microversion: 2.1 time: 0.083991 May 25 16:30:14.152809 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 497/987] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:14 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:14.250861 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-f1615261-1c2b-49c4-91f3-fc3300390e89 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:14.251467 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-f1615261-1c2b-49c4-91f3-fc3300390e89 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: be25cf4d-733b-4999-b6d9-474da04a6444] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:14.258181 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f1615261-1c2b-49c4-91f3-fc3300390e89 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:14.258625 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f1615261-1c2b-49c4-91f3-fc3300390e89 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:14.259381 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f1615261-1c2b-49c4-91f3-fc3300390e89 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:14.259816 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f1615261-1c2b-49c4-91f3-fc3300390e89 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:14.392383 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-f1615261-1c2b-49c4-91f3-fc3300390e89 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:14.400068 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-f1615261-1c2b-49c4-91f3-fc3300390e89 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444" status: 200 len: 1576 microversion: 2.1 time: 0.153113 May 25 16:30:14.400646 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 491/988] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:14 2022] GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:14.580642 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-4c23372d-fd93-4be4-b2de-f38fdae10599 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:14.581402 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-4c23372d-fd93-4be4-b2de-f38fdae10599 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:14.587634 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4c23372d-fd93-4be4-b2de-f38fdae10599 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:14.588161 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4c23372d-fd93-4be4-b2de-f38fdae10599 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:14.588926 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4c23372d-fd93-4be4-b2de-f38fdae10599 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:14.589357 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4c23372d-fd93-4be4-b2de-f38fdae10599 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:14.744081 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-4c23372d-fd93-4be4-b2de-f38fdae10599 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:14.754389 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-4c23372d-fd93-4be4-b2de-f38fdae10599 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1751 microversion: 2.1 time: 0.177584 May 25 16:30:14.754970 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 498/989] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:14 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:15.170510 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-f964652d-d10a-4236-891f-62ff28dd3cc4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:15.171152 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-f964652d-d10a-4236-891f-62ff28dd3cc4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:15.177427 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f964652d-d10a-4236-891f-62ff28dd3cc4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:15.177931 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f964652d-d10a-4236-891f-62ff28dd3cc4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:15.178694 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f964652d-d10a-4236-891f-62ff28dd3cc4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:15.179133 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f964652d-d10a-4236-891f-62ff28dd3cc4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:15.242831 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-f964652d-d10a-4236-891f-62ff28dd3cc4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:15.250951 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-f964652d-d10a-4236-891f-62ff28dd3cc4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1139 microversion: 2.1 time: 0.084897 May 25 16:30:15.251685 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 492/990] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:15 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:15.418255 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-7dae3927-8c32-4913-8775-0e7a5c4ff4a0 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:15.418862 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-7dae3927-8c32-4913-8775-0e7a5c4ff4a0 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: be25cf4d-733b-4999-b6d9-474da04a6444] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:15.426134 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7dae3927-8c32-4913-8775-0e7a5c4ff4a0 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:15.426522 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7dae3927-8c32-4913-8775-0e7a5c4ff4a0 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:15.427278 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7dae3927-8c32-4913-8775-0e7a5c4ff4a0 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:15.427709 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7dae3927-8c32-4913-8775-0e7a5c4ff4a0 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:15.558070 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-7dae3927-8c32-4913-8775-0e7a5c4ff4a0 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:15.565779 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-7dae3927-8c32-4913-8775-0e7a5c4ff4a0 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444" status: 200 len: 1576 microversion: 2.1 time: 0.151420 May 25 16:30:15.566351 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 499/991] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:15 2022] GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:15.774107 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-dfc02f6b-7a82-4b00-b5a6-173b2950b290 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:15.775099 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-dfc02f6b-7a82-4b00-b5a6-173b2950b290 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:15.782919 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dfc02f6b-7a82-4b00-b5a6-173b2950b290 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:15.783374 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dfc02f6b-7a82-4b00-b5a6-173b2950b290 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:15.784444 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dfc02f6b-7a82-4b00-b5a6-173b2950b290 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:15.784891 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dfc02f6b-7a82-4b00-b5a6-173b2950b290 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:15.931352 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-dfc02f6b-7a82-4b00-b5a6-173b2950b290 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:15.940412 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-dfc02f6b-7a82-4b00-b5a6-173b2950b290 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1751 microversion: 2.1 time: 0.172523 May 25 16:30:15.940979 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 493/992] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:15 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:16.267981 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-e9d8cf0e-e5e6-4795-8d54-7e8b0966b9e6 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:16.268576 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-e9d8cf0e-e5e6-4795-8d54-7e8b0966b9e6 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:16.274524 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e9d8cf0e-e5e6-4795-8d54-7e8b0966b9e6 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:16.274960 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e9d8cf0e-e5e6-4795-8d54-7e8b0966b9e6 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:16.275707 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e9d8cf0e-e5e6-4795-8d54-7e8b0966b9e6 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:16.276130 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-e9d8cf0e-e5e6-4795-8d54-7e8b0966b9e6 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:16.342622 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-e9d8cf0e-e5e6-4795-8d54-7e8b0966b9e6 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:16.349926 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-e9d8cf0e-e5e6-4795-8d54-7e8b0966b9e6 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1187 microversion: 2.1 time: 0.085799 May 25 16:30:16.350480 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 500/993] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:16 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1187 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:16.583036 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-11b14d9e-233d-4357-9d8e-7985d3a39d29 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:16.584281 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-11b14d9e-233d-4357-9d8e-7985d3a39d29 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: be25cf4d-733b-4999-b6d9-474da04a6444] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:16.591672 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-11b14d9e-233d-4357-9d8e-7985d3a39d29 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:16.592464 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-11b14d9e-233d-4357-9d8e-7985d3a39d29 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:16.593466 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-11b14d9e-233d-4357-9d8e-7985d3a39d29 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:16.594156 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-11b14d9e-233d-4357-9d8e-7985d3a39d29 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:16.959129 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-065952e9-02f4-4a47-83c5-39a4b6925826 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:16.961023 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-065952e9-02f4-4a47-83c5-39a4b6925826 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:16.975724 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-065952e9-02f4-4a47-83c5-39a4b6925826 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:16.976387 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-065952e9-02f4-4a47-83c5-39a4b6925826 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:16.977420 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-065952e9-02f4-4a47-83c5-39a4b6925826 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:16.978077 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-065952e9-02f4-4a47-83c5-39a4b6925826 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:16.996351 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-11b14d9e-233d-4357-9d8e-7985d3a39d29 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:17.010005 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-11b14d9e-233d-4357-9d8e-7985d3a39d29 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444" status: 200 len: 1576 microversion: 2.1 time: 0.430129 May 25 16:30:17.019453 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 494/994] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:16 2022] GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444 => generated 1576 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:17.345137 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-065952e9-02f4-4a47-83c5-39a4b6925826 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:17.353136 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-065952e9-02f4-4a47-83c5-39a4b6925826 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1751 microversion: 2.1 time: 0.399200 May 25 16:30:17.354037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 501/995] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:16 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1751 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:17.366948 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-1ca1b83d-bbba-491b-82f8-5fad994b18cb tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:17.367498 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-1ca1b83d-bbba-491b-82f8-5fad994b18cb tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:17.373518 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1ca1b83d-bbba-491b-82f8-5fad994b18cb tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:17.374000 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1ca1b83d-bbba-491b-82f8-5fad994b18cb tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:17.374776 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1ca1b83d-bbba-491b-82f8-5fad994b18cb tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:17.375222 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-1ca1b83d-bbba-491b-82f8-5fad994b18cb tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:17.488366 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-1ca1b83d-bbba-491b-82f8-5fad994b18cb tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:17.495891 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-1ca1b83d-bbba-491b-82f8-5fad994b18cb tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1205 microversion: 2.1 time: 0.132828 May 25 16:30:17.496557 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 495/996] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:17 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1205 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:17.616313 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-02f31976-9718-4e50-b8d1-0029d20b9f40 req-1cdb2385-ccbd-430a-8e76-2e8de6165cfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be25cf4d-733b-4999-b6d9-474da04a6444", "name": "network-vif-deleted", "tag": "28e24d33-7178-4533-933f-ce0069b847bd"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:30:17.625953 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-02f31976-9718-4e50-b8d1-0029d20b9f40 req-1cdb2385-ccbd-430a-8e76-2e8de6165cfd service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:17.626385 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-02f31976-9718-4e50-b8d1-0029d20b9f40 req-1cdb2385-ccbd-430a-8e76-2e8de6165cfd service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:17.637605 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-02f31976-9718-4e50-b8d1-0029d20b9f40 req-1cdb2385-ccbd-430a-8e76-2e8de6165cfd service nova] Creating event network-vif-deleted:28e24d33-7178-4533-933f-ce0069b847bd for instance be25cf4d-733b-4999-b6d9-474da04a6444 on hv-cinder-84327 May 25 16:30:17.643231 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-02f31976-9718-4e50-b8d1-0029d20b9f40 req-1cdb2385-ccbd-430a-8e76-2e8de6165cfd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030616 May 25 16:30:17.643904 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 502/997] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:30:18.030889 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-7c2ef3f7-0e39-4dbd-a7e5-3b00fc9fece9 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:18.031614 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-7c2ef3f7-0e39-4dbd-a7e5-3b00fc9fece9 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: be25cf4d-733b-4999-b6d9-474da04a6444] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:18.038991 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7c2ef3f7-0e39-4dbd-a7e5-3b00fc9fece9 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:18.039441 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7c2ef3f7-0e39-4dbd-a7e5-3b00fc9fece9 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:18.040225 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7c2ef3f7-0e39-4dbd-a7e5-3b00fc9fece9 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:18.040662 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7c2ef3f7-0e39-4dbd-a7e5-3b00fc9fece9 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:18.109799 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-7c2ef3f7-0e39-4dbd-a7e5-3b00fc9fece9 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:18.117602 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-7c2ef3f7-0e39-4dbd-a7e5-3b00fc9fece9 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444" status: 200 len: 1389 microversion: 2.1 time: 0.092763 May 25 16:30:18.118126 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 496/998] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:18 2022] GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444 => generated 1389 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:18.371848 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-0707c34e-81c3-4195-84d5-20de6760fd87 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:18.372552 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-0707c34e-81c3-4195-84d5-20de6760fd87 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:18.380872 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0707c34e-81c3-4195-84d5-20de6760fd87 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:18.381309 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0707c34e-81c3-4195-84d5-20de6760fd87 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:18.382104 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0707c34e-81c3-4195-84d5-20de6760fd87 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:18.382533 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0707c34e-81c3-4195-84d5-20de6760fd87 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:18.512657 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-8bcbfeb7-2510-456c-8805-c3c4cd4db9c1 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:18.514258 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-8bcbfeb7-2510-456c-8805-c3c4cd4db9c1 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:18.520429 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8bcbfeb7-2510-456c-8805-c3c4cd4db9c1 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:18.520879 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8bcbfeb7-2510-456c-8805-c3c4cd4db9c1 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:18.521642 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8bcbfeb7-2510-456c-8805-c3c4cd4db9c1 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:18.522108 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8bcbfeb7-2510-456c-8805-c3c4cd4db9c1 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:18.531593 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-0707c34e-81c3-4195-84d5-20de6760fd87 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:18.539896 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-0707c34e-81c3-4195-84d5-20de6760fd87 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1756 microversion: 2.1 time: 0.172848 May 25 16:30:18.540553 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 503/999] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:18 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:18.655353 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-8bcbfeb7-2510-456c-8805-c3c4cd4db9c1 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:18.662764 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-8bcbfeb7-2510-456c-8805-c3c4cd4db9c1 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1273 microversion: 2.1 time: 0.154296 May 25 16:30:18.663332 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 497/1000] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:18 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1273 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:30:19.133905 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-4a38322e-e962-4dea-bd27-c4274ab713b3 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:19.134500 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-4a38322e-e962-4dea-bd27-c4274ab713b3 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: be25cf4d-733b-4999-b6d9-474da04a6444] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:19.140849 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4a38322e-e962-4dea-bd27-c4274ab713b3 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:19.141289 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4a38322e-e962-4dea-bd27-c4274ab713b3 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:19.142066 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4a38322e-e962-4dea-bd27-c4274ab713b3 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:19.142521 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-4a38322e-e962-4dea-bd27-c4274ab713b3 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:19.203229 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-4a38322e-e962-4dea-bd27-c4274ab713b3 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:19.210619 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-4a38322e-e962-4dea-bd27-c4274ab713b3 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444" status: 200 len: 1389 microversion: 2.1 time: 0.080596 May 25 16:30:19.211176 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 504/1001] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:19 2022] GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:19.557778 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-8f704612-8a9c-4966-92fe-ede0f342d63a tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:19.558390 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-8f704612-8a9c-4966-92fe-ede0f342d63a tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:19.565160 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8f704612-8a9c-4966-92fe-ede0f342d63a tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:19.565554 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8f704612-8a9c-4966-92fe-ede0f342d63a tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:19.566350 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8f704612-8a9c-4966-92fe-ede0f342d63a tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:19.566794 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8f704612-8a9c-4966-92fe-ede0f342d63a tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:19.681312 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-f78a4bf5-5312-410b-939d-7e971908e1e3 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:19.682002 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-f78a4bf5-5312-410b-939d-7e971908e1e3 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:19.689010 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f78a4bf5-5312-410b-939d-7e971908e1e3 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:19.689496 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f78a4bf5-5312-410b-939d-7e971908e1e3 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:19.690321 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f78a4bf5-5312-410b-939d-7e971908e1e3 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:19.690757 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f78a4bf5-5312-410b-939d-7e971908e1e3 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:19.718361 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-8f704612-8a9c-4966-92fe-ede0f342d63a tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:19.726492 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-8f704612-8a9c-4966-92fe-ede0f342d63a tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1756 microversion: 2.1 time: 0.172606 May 25 16:30:19.729184 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 498/1002] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:19 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:19.833278 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-f78a4bf5-5312-410b-939d-7e971908e1e3 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:19.841646 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-f78a4bf5-5312-410b-939d-7e971908e1e3 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1273 microversion: 2.1 time: 0.163485 May 25 16:30:19.842379 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 505/1003] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:19 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1273 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:20.228384 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-9f790664-b050-4f6f-848d-058235f66f1f tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:20.228993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-9f790664-b050-4f6f-848d-058235f66f1f tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: be25cf4d-733b-4999-b6d9-474da04a6444] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:20.235321 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9f790664-b050-4f6f-848d-058235f66f1f tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:20.235776 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9f790664-b050-4f6f-848d-058235f66f1f tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:20.236541 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9f790664-b050-4f6f-848d-058235f66f1f tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:20.236981 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9f790664-b050-4f6f-848d-058235f66f1f tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:20.307955 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-9f790664-b050-4f6f-848d-058235f66f1f tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:20.318876 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-9f790664-b050-4f6f-848d-058235f66f1f tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444" status: 200 len: 1224 microversion: 2.1 time: 0.094465 May 25 16:30:20.319512 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 499/1004] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:20 2022] GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:30:20.743930 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-8f85bfec-73ef-4074-8030-2a7c78ee8c35 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:20.745124 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-8f85bfec-73ef-4074-8030-2a7c78ee8c35 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:20.758749 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8f85bfec-73ef-4074-8030-2a7c78ee8c35 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:20.759725 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8f85bfec-73ef-4074-8030-2a7c78ee8c35 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:20.760789 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8f85bfec-73ef-4074-8030-2a7c78ee8c35 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:20.761438 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8f85bfec-73ef-4074-8030-2a7c78ee8c35 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:20.767317 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:30:20.867335 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-8b8804f8-b41b-454e-a756-b447f055cb79 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:20.868909 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-8b8804f8-b41b-454e-a756-b447f055cb79 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:20.878080 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8b8804f8-b41b-454e-a756-b447f055cb79 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:20.879143 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8b8804f8-b41b-454e-a756-b447f055cb79 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:20.880138 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8b8804f8-b41b-454e-a756-b447f055cb79 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:20.880687 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8b8804f8-b41b-454e-a756-b447f055cb79 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:21.072885 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-8f85bfec-73ef-4074-8030-2a7c78ee8c35 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:21.102180 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-8f85bfec-73ef-4074-8030-2a7c78ee8c35 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1756 microversion: 2.1 time: 0.361068 May 25 16:30:21.111396 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 506/1005] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:20 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1756 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:21.126112 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-e5310a40-41dc-4ddb-8cc7-b6a6d4786f25 req-e59de7a4-c927-4019-9e6e-0be789d4aca0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67d74924-5509-4362-b314-27e375267a10", "tag": "0a1fd3e6-89fa-451b-a2f8-e586a9d6a09a"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:30:21.136702 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-e5310a40-41dc-4ddb-8cc7-b6a6d4786f25 req-e59de7a4-c927-4019-9e6e-0be789d4aca0 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:21.137265 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-e5310a40-41dc-4ddb-8cc7-b6a6d4786f25 req-e59de7a4-c927-4019-9e6e-0be789d4aca0 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:21.154319 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-e5310a40-41dc-4ddb-8cc7-b6a6d4786f25 req-e59de7a4-c927-4019-9e6e-0be789d4aca0 service nova] Creating event network-changed:0a1fd3e6-89fa-451b-a2f8-e586a9d6a09a for instance 67d74924-5509-4362-b314-27e375267a10 on hv-cinder-84327 May 25 16:30:21.162504 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-e5310a40-41dc-4ddb-8cc7-b6a6d4786f25 req-e59de7a4-c927-4019-9e6e-0be789d4aca0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049212 May 25 16:30:21.163960 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 507/1006] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:30:21.267681 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-8b8804f8-b41b-454e-a756-b447f055cb79 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:21.290084 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-8b8804f8-b41b-454e-a756-b447f055cb79 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1261 microversion: 2.1 time: 0.433799 May 25 16:30:21.301306 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 500/1007] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:20 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1261 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:21.341890 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-c80b7ab6-62a2-42d9-b00d-73783f6eba59 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:21.343007 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-c80b7ab6-62a2-42d9-b00d-73783f6eba59 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: be25cf4d-733b-4999-b6d9-474da04a6444] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:21.351159 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c80b7ab6-62a2-42d9-b00d-73783f6eba59 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:21.351816 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c80b7ab6-62a2-42d9-b00d-73783f6eba59 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:21.352937 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c80b7ab6-62a2-42d9-b00d-73783f6eba59 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:21.353635 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c80b7ab6-62a2-42d9-b00d-73783f6eba59 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:21.370337 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.wsgi [None req-c80b7ab6-62a2-42d9-b00d-73783f6eba59 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] HTTP exception thrown: Instance be25cf4d-733b-4999-b6d9-474da04a6444 could not be found. May 25 16:30:21.372991 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-c80b7ab6-62a2-42d9-b00d-73783f6eba59 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Request method failure captured: May 25 16:30:21.372991 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444 HTTP/1.1 May 25 16:30:21.372991 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:30:21.372991 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:30:21.372991 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:30:21.372991 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 0 May 25 16:30:21.372991 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:30:21.372991 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:30:21.372991 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:30:21.372991 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:30:21.372991 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijlelzdsMf1DE_OJe4dAbolblNKTr5NJvI-0q9wR4ptTmYRXo7rIjfLWlJ8nvNyeHfiuhnvR9gWqRK6NHlHVGZOOk2Ahu15RsMbq4KZCpetI0YLeLWc9IC0N_3ktKyFVJ0plPOQzLQb0HgErkzSh6xF6AXOk6u3gHvA9r-zcV9P757SM May 25 16:30:21.372991 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:30:21.372991 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:30:21.372991 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:30:21.372991 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:30:21.372991 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:30:21.372991 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:30:21.372991 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: a40431f830294ea0a6395be072560dea May 25 16:30:21.372991 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-TestVolumeBootPattern-617412873 May 25 16:30:21.372991 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:30:21.372991 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:30:21.374794 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a40431f830294ea0a6395be072560dea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a40431f830294ea0a6395be072560dea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a40431f830294ea0a6395be072560dea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a40431f830294ea0a6395be072560dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:30:21.374794 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-TestVolumeBootPattern-617412873 May 25 16:30:21.374794 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: a40431f830294ea0a6395be072560dea May 25 16:30:21.374794 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-TestVolumeBootPattern-617412873 May 25 16:30:21.374794 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-TestVolumeBootPattern-617412873-project May 25 16:30:21.374794 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:30:21.374794 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:30:21.374794 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: c935f035c757482ca912a8c4b77714a0 May 25 16:30:21.374794 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-TestVolumeBootPattern-617412873-project May 25 16:30:21.374794 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: > May 25 16:30:21.374794 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Instance be25cf4d-733b-4999-b6d9-474da04a6444 could not be found. May 25 16:30:21.374794 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'id': 'be25cf4d-733b-4999-b6d9-474da04a6444'} May 25 16:30:21.375775 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:30:21.375775 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:30:21.375775 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:30:21.375775 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:30:21.375775 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:30:21.375775 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:30:21.375775 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:30:21.375775 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:30:21.375775 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:30:21.375775 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:30:21.375775 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be25cf4d-733b-4999-b6d9-474da04a6444 could not be found. May 25 16:30:21.375775 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:30:21.375775 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:30:21.375775 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:30:21.375775 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:30:21.375775 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:30:21.375775 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:30:21.375775 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:30:21.375775 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:30:21.375775 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:30:21.377404 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:30:21.377404 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:30:21.377404 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:30:21.377404 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:30:21.377404 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:30:21.377404 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:30:21.377404 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:30:21.377404 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be25cf4d-733b-4999-b6d9-474da04a6444 could not be found. May 25 16:30:21.377404 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:30:21.377404 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:30:21.377404 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:30:21.377404 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:30:21.377404 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:30:21.377404 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:30:21.377404 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:30:21.377404 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:30:21.377404 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be25cf4d-733b-4999-b6d9-474da04a6444 could not be found. May 25 16:30:21.377404 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:30:21.378966 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-c80b7ab6-62a2-42d9-b00d-73783f6eba59 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Returning 404 to user: Instance be25cf4d-733b-4999-b6d9-474da04a6444 could not be found. {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:30:21.379655 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-c80b7ab6-62a2-42d9-b00d-73783f6eba59 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444" status: 404 len: 111 microversion: 2.1 time: 0.046134 May 25 16:30:21.380462 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 508/1008] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:21 2022] GET /compute/v2.1/servers/be25cf4d-733b-4999-b6d9-474da04a6444 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:30:22.125625 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-40f7bc0a-5c11-41ed-a39e-ede360b6eda3 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:22.126240 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-40f7bc0a-5c11-41ed-a39e-ede360b6eda3 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:22.128105 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell0:SELECT=2 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:30:22.129231 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell0:SELECT=8 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:30:22.135207 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-40f7bc0a-5c11-41ed-a39e-ede360b6eda3 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:22.135656 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-40f7bc0a-5c11-41ed-a39e-ede360b6eda3 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:22.136417 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-40f7bc0a-5c11-41ed-a39e-ede360b6eda3 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:22.136856 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-40f7bc0a-5c11-41ed-a39e-ede360b6eda3 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:22.286322 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-40f7bc0a-5c11-41ed-a39e-ede360b6eda3 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:22.294833 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-40f7bc0a-5c11-41ed-a39e-ede360b6eda3 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1756 microversion: 2.1 time: 0.172968 May 25 16:30:22.295374 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 501/1009] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:22 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:22.308098 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-39619067-0247-4e43-a471-dbeaae091b26 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:22.308711 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-39619067-0247-4e43-a471-dbeaae091b26 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:22.315830 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-39619067-0247-4e43-a471-dbeaae091b26 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:22.316281 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-39619067-0247-4e43-a471-dbeaae091b26 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:22.317076 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-39619067-0247-4e43-a471-dbeaae091b26 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:22.317520 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-39619067-0247-4e43-a471-dbeaae091b26 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:22.448834 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-39619067-0247-4e43-a471-dbeaae091b26 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:22.456926 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-39619067-0247-4e43-a471-dbeaae091b26 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1261 microversion: 2.1 time: 0.152805 May 25 16:30:22.457489 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 509/1010] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:22 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:23.312255 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-a26db78a-082f-4fc9-a67b-c54121a4775d tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:23.312862 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-a26db78a-082f-4fc9-a67b-c54121a4775d tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:23.319409 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a26db78a-082f-4fc9-a67b-c54121a4775d tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:23.319881 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a26db78a-082f-4fc9-a67b-c54121a4775d tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:23.320641 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a26db78a-082f-4fc9-a67b-c54121a4775d tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:23.321077 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a26db78a-082f-4fc9-a67b-c54121a4775d tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:23.463033 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-a26db78a-082f-4fc9-a67b-c54121a4775d tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:23.467195 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:30:23.473595 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-a26db78a-082f-4fc9-a67b-c54121a4775d tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1756 microversion: 2.1 time: 0.165544 May 25 16:30:23.474196 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 502/1011] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:23 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:23.474325 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-b58db860-133b-4b12-9784-9f7167ba6b36 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:23.475023 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-b58db860-133b-4b12-9784-9f7167ba6b36 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:23.481691 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b58db860-133b-4b12-9784-9f7167ba6b36 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:23.482161 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b58db860-133b-4b12-9784-9f7167ba6b36 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:23.482928 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b58db860-133b-4b12-9784-9f7167ba6b36 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:23.483366 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b58db860-133b-4b12-9784-9f7167ba6b36 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:23.618281 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-b58db860-133b-4b12-9784-9f7167ba6b36 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:23.626179 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-b58db860-133b-4b12-9784-9f7167ba6b36 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1261 microversion: 2.1 time: 0.156219 May 25 16:30:23.626725 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 510/1012] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:23 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:24.490572 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-d7cf0162-a7ae-42c9-890c-287338542ef9 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:24.491152 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-d7cf0162-a7ae-42c9-890c-287338542ef9 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:24.498209 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d7cf0162-a7ae-42c9-890c-287338542ef9 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:24.498656 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d7cf0162-a7ae-42c9-890c-287338542ef9 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:24.499418 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d7cf0162-a7ae-42c9-890c-287338542ef9 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:24.499846 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d7cf0162-a7ae-42c9-890c-287338542ef9 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:24.643152 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-c0ed37d0-0453-4d32-acf2-ef9feb1ad218 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:24.644016 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-c0ed37d0-0453-4d32-acf2-ef9feb1ad218 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:24.650697 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c0ed37d0-0453-4d32-acf2-ef9feb1ad218 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:24.651213 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c0ed37d0-0453-4d32-acf2-ef9feb1ad218 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:24.652057 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c0ed37d0-0453-4d32-acf2-ef9feb1ad218 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:24.652552 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c0ed37d0-0453-4d32-acf2-ef9feb1ad218 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:24.785518 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-d7cf0162-a7ae-42c9-890c-287338542ef9 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:24.795070 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-d7cf0162-a7ae-42c9-890c-287338542ef9 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1756 microversion: 2.1 time: 0.307803 May 25 16:30:24.796089 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 503/1013] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:24 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1756 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:24.864136 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-c0ed37d0-0453-4d32-acf2-ef9feb1ad218 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:24.871942 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-c0ed37d0-0453-4d32-acf2-ef9feb1ad218 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1261 microversion: 2.1 time: 0.232649 May 25 16:30:24.872868 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 511/1014] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:24 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1261 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:25.815237 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-0420200f-b862-460d-8ff9-db4f337872ee tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:25.815979 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-0420200f-b862-460d-8ff9-db4f337872ee tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:25.822922 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0420200f-b862-460d-8ff9-db4f337872ee tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:25.823417 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0420200f-b862-460d-8ff9-db4f337872ee tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:25.824186 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0420200f-b862-460d-8ff9-db4f337872ee tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:25.824724 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0420200f-b862-460d-8ff9-db4f337872ee tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:25.888790 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-76809079-4881-487e-b2f6-614156b0ae34 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:25.889433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-76809079-4881-487e-b2f6-614156b0ae34 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:25.896200 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-76809079-4881-487e-b2f6-614156b0ae34 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:25.896645 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-76809079-4881-487e-b2f6-614156b0ae34 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:25.897426 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-76809079-4881-487e-b2f6-614156b0ae34 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:25.897890 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-76809079-4881-487e-b2f6-614156b0ae34 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:26.320367 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-76809079-4881-487e-b2f6-614156b0ae34 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:26.325998 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-0420200f-b862-460d-8ff9-db4f337872ee tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:26.328789 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-76809079-4881-487e-b2f6-614156b0ae34 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1261 microversion: 2.1 time: 0.444132 May 25 16:30:26.329440 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 512/1015] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:25 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1261 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:30:26.333853 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-0420200f-b862-460d-8ff9-db4f337872ee tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1756 microversion: 2.1 time: 0.524800 May 25 16:30:26.334417 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 504/1016] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:25 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1756 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:27.346775 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-c6ad2007-7c77-4ce1-807a-5adca7010d69 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:27.347392 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-c6ad2007-7c77-4ce1-807a-5adca7010d69 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:27.352027 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-ad772cce-31ae-41da-a819-5cbd585a43da tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:27.352761 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-ad772cce-31ae-41da-a819-5cbd585a43da tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:27.354045 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c6ad2007-7c77-4ce1-807a-5adca7010d69 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:27.354492 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c6ad2007-7c77-4ce1-807a-5adca7010d69 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:27.355250 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c6ad2007-7c77-4ce1-807a-5adca7010d69 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:27.355691 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-c6ad2007-7c77-4ce1-807a-5adca7010d69 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:27.359876 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ad772cce-31ae-41da-a819-5cbd585a43da tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:27.360450 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ad772cce-31ae-41da-a819-5cbd585a43da tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:27.361327 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ad772cce-31ae-41da-a819-5cbd585a43da tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:27.361969 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-ad772cce-31ae-41da-a819-5cbd585a43da tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:27.650886 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-c6ad2007-7c77-4ce1-807a-5adca7010d69 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:27.660518 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-c6ad2007-7c77-4ce1-807a-5adca7010d69 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1261 microversion: 2.1 time: 0.317686 May 25 16:30:27.660672 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-ad772cce-31ae-41da-a819-5cbd585a43da tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:27.661338 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 513/1017] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:27 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1261 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:30:27.669895 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-ad772cce-31ae-41da-a819-5cbd585a43da tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1756 microversion: 2.1 time: 0.321701 May 25 16:30:27.670480 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 505/1018] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:27 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1756 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:27.876235 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-41287cbc-7e31-4932-a111-66ed6f88851e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:27.876739 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-41287cbc-7e31-4932-a111-66ed6f88851e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:27.878006 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-18e2d051-3b57-4935-9f86-fe6ff426a6d2 req-d5056451-9bde-40a9-8a70-eab1a561a78b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5ebfa48-d140-464a-8556-590a2666ce0c", "tag": "414a4851-4f1f-4eac-9236-89ed850b9b5a"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:30:27.884445 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-41287cbc-7e31-4932-a111-66ed6f88851e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:27.884958 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-41287cbc-7e31-4932-a111-66ed6f88851e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:27.885763 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-41287cbc-7e31-4932-a111-66ed6f88851e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:27.886244 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-41287cbc-7e31-4932-a111-66ed6f88851e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:27.893162 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-18e2d051-3b57-4935-9f86-fe6ff426a6d2 req-d5056451-9bde-40a9-8a70-eab1a561a78b service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:27.895201 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-18e2d051-3b57-4935-9f86-fe6ff426a6d2 req-d5056451-9bde-40a9-8a70-eab1a561a78b service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:27.914172 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-41287cbc-7e31-4932-a111-66ed6f88851e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] Going to try to terminate instance {{(pid=117509) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:30:27.923383 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-18e2d051-3b57-4935-9f86-fe6ff426a6d2 req-d5056451-9bde-40a9-8a70-eab1a561a78b service nova] Creating event network-changed:414a4851-4f1f-4eac-9236-89ed850b9b5a for instance b5ebfa48-d140-464a-8556-590a2666ce0c on hv-cinder-84327 May 25 16:30:27.928609 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-18e2d051-3b57-4935-9f86-fe6ff426a6d2 req-d5056451-9bde-40a9-8a70-eab1a561a78b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055266 May 25 16:30:27.932147 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 506/1019] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:30:28.008056 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-41287cbc-7e31-4932-a111-66ed6f88851e tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c" status: 204 len: 0 microversion: 2.1 time: 0.140717 May 25 16:30:28.009243 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 514/1020] 10.222.0.42 () {58 vars in 1238 bytes} [Wed May 25 16:30:27 2022] DELETE /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:30:28.018514 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-85c65646-84f1-49ce-9a91-7593806b9f46 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:28.019487 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-85c65646-84f1-49ce-9a91-7593806b9f46 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:28.026089 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-85c65646-84f1-49ce-9a91-7593806b9f46 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:28.026546 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-85c65646-84f1-49ce-9a91-7593806b9f46 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:28.027324 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-85c65646-84f1-49ce-9a91-7593806b9f46 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:28.027767 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-85c65646-84f1-49ce-9a91-7593806b9f46 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:28.212056 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-85c65646-84f1-49ce-9a91-7593806b9f46 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:28.220237 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-85c65646-84f1-49ce-9a91-7593806b9f46 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c" status: 200 len: 1577 microversion: 2.1 time: 0.206607 May 25 16:30:28.220930 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 507/1021] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:28 2022] GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c => generated 1577 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:28.678467 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-b8bc939a-7434-40f1-8b8e-eeef7698b8ca tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:28.679183 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-b8bc939a-7434-40f1-8b8e-eeef7698b8ca tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:28.686995 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b8bc939a-7434-40f1-8b8e-eeef7698b8ca tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:28.687239 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b8bc939a-7434-40f1-8b8e-eeef7698b8ca tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:28.687594 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-7e0a04af-9cb4-4c54-b715-b9ea8e108abf tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:28.688037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b8bc939a-7434-40f1-8b8e-eeef7698b8ca tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:28.688261 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-7e0a04af-9cb4-4c54-b715-b9ea8e108abf tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:28.688412 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-b8bc939a-7434-40f1-8b8e-eeef7698b8ca tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:28.697066 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7e0a04af-9cb4-4c54-b715-b9ea8e108abf tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:28.697617 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7e0a04af-9cb4-4c54-b715-b9ea8e108abf tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:28.698510 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7e0a04af-9cb4-4c54-b715-b9ea8e108abf tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:28.698954 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7e0a04af-9cb4-4c54-b715-b9ea8e108abf tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:28.885791 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-b8bc939a-7434-40f1-8b8e-eeef7698b8ca tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:28.893601 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-b8bc939a-7434-40f1-8b8e-eeef7698b8ca tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1261 microversion: 2.1 time: 0.219476 May 25 16:30:28.894217 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 515/1022] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:28 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1261 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:28.912669 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-7e0a04af-9cb4-4c54-b715-b9ea8e108abf tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:28.922224 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-7e0a04af-9cb4-4c54-b715-b9ea8e108abf tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1756 microversion: 2.1 time: 0.238539 May 25 16:30:28.923241 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 508/1023] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:28 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1756 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:28.966206 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-abec6442-7754-4c6b-b53c-c65855f1e0c0 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:28.966937 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-abec6442-7754-4c6b-b53c-c65855f1e0c0 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: ea7289e9-fc54-4ad9-b784-32751344f97d] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:28.972848 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-abec6442-7754-4c6b-b53c-c65855f1e0c0 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:28.973290 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-abec6442-7754-4c6b-b53c-c65855f1e0c0 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:28.974069 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-abec6442-7754-4c6b-b53c-c65855f1e0c0 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:28.974501 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-abec6442-7754-4c6b-b53c-c65855f1e0c0 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:29.059085 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.objects.instance [None req-abec6442-7754-4c6b-b53c-c65855f1e0c0 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lazy-loading 'services' on Instance uuid ea7289e9-fc54-4ad9-b784-32751344f97d {{(pid=117509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:30:29.129355 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-abec6442-7754-4c6b-b53c-c65855f1e0c0 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d/os-volume_attachments/204207b3-b4cf-4335-bdea-28eac8af979b" status: 202 len: 0 microversion: 2.1 time: 0.167500 May 25 16:30:29.129975 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 516/1024] 10.222.0.42 () {58 vars in 1415 bytes} [Wed May 25 16:30:28 2022] DELETE /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d/os-volume_attachments/204207b3-b4cf-4335-bdea-28eac8af979b => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:30:29.238568 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-58649ae6-1068-4cc1-b10e-9eb48d3c0892 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:29.239119 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-58649ae6-1068-4cc1-b10e-9eb48d3c0892 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:29.245359 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-58649ae6-1068-4cc1-b10e-9eb48d3c0892 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:29.245841 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-58649ae6-1068-4cc1-b10e-9eb48d3c0892 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:29.246608 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-58649ae6-1068-4cc1-b10e-9eb48d3c0892 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:29.247084 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-58649ae6-1068-4cc1-b10e-9eb48d3c0892 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:29.416204 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-58649ae6-1068-4cc1-b10e-9eb48d3c0892 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:29.423543 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-58649ae6-1068-4cc1-b10e-9eb48d3c0892 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c" status: 200 len: 1577 microversion: 2.1 time: 0.188977 May 25 16:30:29.424105 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 509/1025] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:29 2022] GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c => generated 1577 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:29.910772 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-2c56f1fd-535c-414d-9dac-1e4e68df6fff tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:29.911464 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-2c56f1fd-535c-414d-9dac-1e4e68df6fff tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:29.918500 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2c56f1fd-535c-414d-9dac-1e4e68df6fff tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:29.918942 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2c56f1fd-535c-414d-9dac-1e4e68df6fff tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:29.919723 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2c56f1fd-535c-414d-9dac-1e4e68df6fff tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:29.920150 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2c56f1fd-535c-414d-9dac-1e4e68df6fff tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:29.940775 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-7d5621d0-98f4-4032-817a-034f63f959c7 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:29.941522 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-7d5621d0-98f4-4032-817a-034f63f959c7 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:29.947974 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7d5621d0-98f4-4032-817a-034f63f959c7 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:29.948417 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7d5621d0-98f4-4032-817a-034f63f959c7 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:29.949180 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7d5621d0-98f4-4032-817a-034f63f959c7 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:29.949611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7d5621d0-98f4-4032-817a-034f63f959c7 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:30.111940 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-2c56f1fd-535c-414d-9dac-1e4e68df6fff tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:30.119427 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-2c56f1fd-535c-414d-9dac-1e4e68df6fff tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1261 microversion: 2.1 time: 0.212850 May 25 16:30:30.120074 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 517/1026] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:29 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1261 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:30.144057 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-7d5621d0-98f4-4032-817a-034f63f959c7 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:30.152014 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-7d5621d0-98f4-4032-817a-034f63f959c7 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1756 microversion: 2.1 time: 0.215366 May 25 16:30:30.152579 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 510/1027] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:29 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1756 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:30.440615 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-16cab22e-e7a6-48bb-9820-e1fb07ecbc46 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:30.441236 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-16cab22e-e7a6-48bb-9820-e1fb07ecbc46 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:30.447283 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-16cab22e-e7a6-48bb-9820-e1fb07ecbc46 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:30.447723 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-16cab22e-e7a6-48bb-9820-e1fb07ecbc46 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:30.448474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-16cab22e-e7a6-48bb-9820-e1fb07ecbc46 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:30.448903 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-16cab22e-e7a6-48bb-9820-e1fb07ecbc46 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:30.584497 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-16cab22e-e7a6-48bb-9820-e1fb07ecbc46 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:30.592793 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-16cab22e-e7a6-48bb-9820-e1fb07ecbc46 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c" status: 200 len: 1577 microversion: 2.1 time: 0.156082 May 25 16:30:30.593388 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 518/1028] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:30 2022] GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:31.137462 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-a43c5459-00a5-4ee7-a757-fe734b1bf87a tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:31.138926 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-a43c5459-00a5-4ee7-a757-fe734b1bf87a tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:31.145336 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a43c5459-00a5-4ee7-a757-fe734b1bf87a tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:31.145818 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a43c5459-00a5-4ee7-a757-fe734b1bf87a tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:31.146577 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a43c5459-00a5-4ee7-a757-fe734b1bf87a tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:31.147010 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a43c5459-00a5-4ee7-a757-fe734b1bf87a tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:31.170176 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-5fde28a9-1fad-4a79-99dc-55e3a0c74148 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:31.170878 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-5fde28a9-1fad-4a79-99dc-55e3a0c74148 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:31.177420 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5fde28a9-1fad-4a79-99dc-55e3a0c74148 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:31.177929 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5fde28a9-1fad-4a79-99dc-55e3a0c74148 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:31.178696 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5fde28a9-1fad-4a79-99dc-55e3a0c74148 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:31.179269 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5fde28a9-1fad-4a79-99dc-55e3a0c74148 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:31.342276 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-a43c5459-00a5-4ee7-a757-fe734b1bf87a tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:31.350185 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-a43c5459-00a5-4ee7-a757-fe734b1bf87a tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1261 microversion: 2.1 time: 0.216560 May 25 16:30:31.350780 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 511/1029] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:31 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1261 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:31.371662 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-5fde28a9-1fad-4a79-99dc-55e3a0c74148 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:31.382143 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-5fde28a9-1fad-4a79-99dc-55e3a0c74148 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1759 microversion: 2.1 time: 0.215678 May 25 16:30:31.383565 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 519/1030] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:31 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1759 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:30:31.610464 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-82d32278-a68b-41f0-bdbe-5518842d13cf tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:31.611073 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-82d32278-a68b-41f0-bdbe-5518842d13cf tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:31.616914 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-82d32278-a68b-41f0-bdbe-5518842d13cf tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:31.617362 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-82d32278-a68b-41f0-bdbe-5518842d13cf tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:31.618224 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-82d32278-a68b-41f0-bdbe-5518842d13cf tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:31.618660 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-82d32278-a68b-41f0-bdbe-5518842d13cf tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:31.817375 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-82d32278-a68b-41f0-bdbe-5518842d13cf tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:31.825562 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-82d32278-a68b-41f0-bdbe-5518842d13cf tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c" status: 200 len: 1458 microversion: 2.1 time: 0.218889 May 25 16:30:31.826237 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 512/1031] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:31 2022] GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c => generated 1458 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:31.986669 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-d7ed0fa7-2d09-451b-9810-c31f3170a7e5 req-2099ef53-edaa-45a1-a58f-ece3b6be206f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5ebfa48-d140-464a-8556-590a2666ce0c", "name": "network-vif-deleted", "tag": "414a4851-4f1f-4eac-9236-89ed850b9b5a"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:30:31.995056 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-d7ed0fa7-2d09-451b-9810-c31f3170a7e5 req-2099ef53-edaa-45a1-a58f-ece3b6be206f service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:31.995499 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-d7ed0fa7-2d09-451b-9810-c31f3170a7e5 req-2099ef53-edaa-45a1-a58f-ece3b6be206f service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:32.007534 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-d7ed0fa7-2d09-451b-9810-c31f3170a7e5 req-2099ef53-edaa-45a1-a58f-ece3b6be206f service nova] Creating event network-vif-deleted:414a4851-4f1f-4eac-9236-89ed850b9b5a for instance b5ebfa48-d140-464a-8556-590a2666ce0c on hv-cinder-84327 May 25 16:30:32.013278 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-d7ed0fa7-2d09-451b-9810-c31f3170a7e5 req-2099ef53-edaa-45a1-a58f-ece3b6be206f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029639 May 25 16:30:32.013901 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 520/1032] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:30:32.366011 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-28b0620d-45bd-4e28-a7d0-316033cf41e1 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:32.366621 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-28b0620d-45bd-4e28-a7d0-316033cf41e1 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:32.374053 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-276abfcc-ef6e-49bd-a84a-a5eec53df635 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:32.374591 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-28b0620d-45bd-4e28-a7d0-316033cf41e1 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:32.374591 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-28b0620d-45bd-4e28-a7d0-316033cf41e1 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:32.374772 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-276abfcc-ef6e-49bd-a84a-a5eec53df635 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: ea7289e9-fc54-4ad9-b784-32751344f97d] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:32.375353 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-28b0620d-45bd-4e28-a7d0-316033cf41e1 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:32.375788 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-28b0620d-45bd-4e28-a7d0-316033cf41e1 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:32.383273 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-276abfcc-ef6e-49bd-a84a-a5eec53df635 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:32.383726 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-276abfcc-ef6e-49bd-a84a-a5eec53df635 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:32.384536 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-276abfcc-ef6e-49bd-a84a-a5eec53df635 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:32.385159 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-276abfcc-ef6e-49bd-a84a-a5eec53df635 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:32.414152 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-276abfcc-ef6e-49bd-a84a-a5eec53df635 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: ea7289e9-fc54-4ad9-b784-32751344f97d] Going to try to terminate instance {{(pid=117509) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:30:32.446067 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:30:32.499712 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-276abfcc-ef6e-49bd-a84a-a5eec53df635 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d" status: 204 len: 0 microversion: 2.1 time: 0.130695 May 25 16:30:32.500300 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 521/1033] 10.222.0.42 () {58 vars in 1238 bytes} [Wed May 25 16:30:32 2022] DELETE /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 25 16:30:32.508775 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-a41e1aa1-307f-4266-ae69-824236a04906 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:32.509484 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-a41e1aa1-307f-4266-ae69-824236a04906 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: ea7289e9-fc54-4ad9-b784-32751344f97d] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:32.515919 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a41e1aa1-307f-4266-ae69-824236a04906 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:32.516385 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a41e1aa1-307f-4266-ae69-824236a04906 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:32.517144 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a41e1aa1-307f-4266-ae69-824236a04906 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:32.517575 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a41e1aa1-307f-4266-ae69-824236a04906 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:32.541642 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-28b0620d-45bd-4e28-a7d0-316033cf41e1 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:32.563359 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-28b0620d-45bd-4e28-a7d0-316033cf41e1 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1261 microversion: 2.1 time: 0.201152 May 25 16:30:32.563947 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 513/1034] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:32 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1261 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:32.665293 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-a41e1aa1-307f-4266-ae69-824236a04906 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d0cf08accf4a28b85ac2342d9c3023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6a5a6ae8b2488f8a5af6d2066fa88e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:32.673658 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-a41e1aa1-307f-4266-ae69-824236a04906 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "GET /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d" status: 200 len: 1513 microversion: 2.1 time: 0.169060 May 25 16:30:32.674270 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 522/1035] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:32 2022] GET /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:30:32.842880 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-3c2346cf-9d37-471b-8425-dd07119bfb03 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:32.843521 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-3c2346cf-9d37-471b-8425-dd07119bfb03 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:32.849449 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3c2346cf-9d37-471b-8425-dd07119bfb03 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:32.849926 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3c2346cf-9d37-471b-8425-dd07119bfb03 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:32.850693 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3c2346cf-9d37-471b-8425-dd07119bfb03 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:32.851128 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3c2346cf-9d37-471b-8425-dd07119bfb03 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:32.880593 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3c2346cf-9d37-471b-8425-dd07119bfb03 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:32.881041 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3c2346cf-9d37-471b-8425-dd07119bfb03 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:32.881484 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.objects.instance [None req-3c2346cf-9d37-471b-8425-dd07119bfb03 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lazy-loading 'fault' on Instance uuid b5ebfa48-d140-464a-8556-590a2666ce0c {{(pid=117510) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:30:32.921682 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-3c2346cf-9d37-471b-8425-dd07119bfb03 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c935f035c757482ca912a8c4b77714a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40431f830294ea0a6395be072560dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:32.929065 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-3c2346cf-9d37-471b-8425-dd07119bfb03 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c" status: 200 len: 1230 microversion: 2.1 time: 0.091126 May 25 16:30:32.929624 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 514/1036] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:32 2022] GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c => generated 1230 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:33.580844 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-0abaa9a4-24d8-4342-90cc-10098e149927 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:33.581454 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-0abaa9a4-24d8-4342-90cc-10098e149927 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:33.588247 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0abaa9a4-24d8-4342-90cc-10098e149927 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:33.588702 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0abaa9a4-24d8-4342-90cc-10098e149927 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:33.589492 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0abaa9a4-24d8-4342-90cc-10098e149927 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:33.589960 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0abaa9a4-24d8-4342-90cc-10098e149927 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:33.691773 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-d2b8a0d6-776f-4074-a87a-581aef2acae7 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:33.692985 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-d2b8a0d6-776f-4074-a87a-581aef2acae7 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: ea7289e9-fc54-4ad9-b784-32751344f97d] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:33.700723 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d2b8a0d6-776f-4074-a87a-581aef2acae7 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:33.700839 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d2b8a0d6-776f-4074-a87a-581aef2acae7 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:33.702011 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d2b8a0d6-776f-4074-a87a-581aef2acae7 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:33.702448 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-d2b8a0d6-776f-4074-a87a-581aef2acae7 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:33.735194 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-0abaa9a4-24d8-4342-90cc-10098e149927 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:33.743213 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-0abaa9a4-24d8-4342-90cc-10098e149927 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1261 microversion: 2.1 time: 0.166178 May 25 16:30:33.743813 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 523/1037] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:33 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:33.843751 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-d2b8a0d6-776f-4074-a87a-581aef2acae7 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d0cf08accf4a28b85ac2342d9c3023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6a5a6ae8b2488f8a5af6d2066fa88e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:33.851237 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-d2b8a0d6-776f-4074-a87a-581aef2acae7 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "GET /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d" status: 200 len: 1513 microversion: 2.1 time: 0.163406 May 25 16:30:33.851791 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 515/1038] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:33 2022] GET /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:30:33.947228 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-07c62bc9-9ae0-49d0-80d0-f570d15d0970 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:33.947795 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-07c62bc9-9ae0-49d0-80d0-f570d15d0970 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: b5ebfa48-d140-464a-8556-590a2666ce0c] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:33.954537 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-07c62bc9-9ae0-49d0-80d0-f570d15d0970 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:33.954995 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-07c62bc9-9ae0-49d0-80d0-f570d15d0970 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:33.955766 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-07c62bc9-9ae0-49d0-80d0-f570d15d0970 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:33.956209 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-07c62bc9-9ae0-49d0-80d0-f570d15d0970 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:33.970220 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.wsgi [None req-07c62bc9-9ae0-49d0-80d0-f570d15d0970 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] HTTP exception thrown: Instance b5ebfa48-d140-464a-8556-590a2666ce0c could not be found. May 25 16:30:33.971881 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-07c62bc9-9ae0-49d0-80d0-f570d15d0970 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Request method failure captured: May 25 16:30:33.971881 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c HTTP/1.1 May 25 16:30:33.971881 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:30:33.971881 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:30:33.971881 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:30:33.971881 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 0 May 25 16:30:33.971881 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:30:33.971881 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:30:33.971881 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:30:33.971881 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:30:33.971881 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijlelzdsMf1DE_OJe4dAbolblNKTr5NJvI-0q9wR4ptTmYRXo7rIjfLWlJ8nvNyeHfiuhnvR9gWqRK6NHlHVGZOOk2Ahu15RsMbq4KZCpetI0YLeLWc9IC0N_3ktKyFVJ0plPOQzLQb0HgErkzSh6xF6AXOk6u3gHvA9r-zcV9P757SM May 25 16:30:33.971881 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:30:33.971881 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:30:33.971881 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:30:33.971881 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:30:33.971881 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:30:33.971881 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:30:33.971881 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: a40431f830294ea0a6395be072560dea May 25 16:30:33.971881 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-TestVolumeBootPattern-617412873 May 25 16:30:33.971881 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:30:33.971881 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:30:33.973622 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a40431f830294ea0a6395be072560dea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a40431f830294ea0a6395be072560dea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a40431f830294ea0a6395be072560dea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a40431f830294ea0a6395be072560dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:30:33.973622 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-TestVolumeBootPattern-617412873 May 25 16:30:33.973622 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: a40431f830294ea0a6395be072560dea May 25 16:30:33.973622 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-TestVolumeBootPattern-617412873 May 25 16:30:33.973622 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-TestVolumeBootPattern-617412873-project May 25 16:30:33.973622 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:30:33.973622 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:30:33.973622 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: c935f035c757482ca912a8c4b77714a0 May 25 16:30:33.973622 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-TestVolumeBootPattern-617412873-project May 25 16:30:33.973622 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: > May 25 16:30:33.973622 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Instance b5ebfa48-d140-464a-8556-590a2666ce0c could not be found. May 25 16:30:33.973622 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'id': 'b5ebfa48-d140-464a-8556-590a2666ce0c'} May 25 16:30:33.974641 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:30:33.974641 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:30:33.974641 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:30:33.974641 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:30:33.974641 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:30:33.974641 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:30:33.974641 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:30:33.974641 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:30:33.974641 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:30:33.974641 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:30:33.974641 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5ebfa48-d140-464a-8556-590a2666ce0c could not be found. May 25 16:30:33.974641 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:30:33.974641 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:30:33.974641 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:30:33.974641 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:30:33.974641 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:30:33.974641 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:30:33.974641 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:30:33.974641 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:30:33.974641 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:30:33.976228 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:30:33.976228 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:30:33.976228 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:30:33.976228 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:30:33.976228 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:30:33.976228 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:30:33.976228 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:30:33.976228 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5ebfa48-d140-464a-8556-590a2666ce0c could not be found. May 25 16:30:33.976228 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:30:33.976228 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:30:33.976228 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:30:33.976228 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:30:33.976228 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:30:33.976228 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:30:33.976228 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:30:33.976228 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:30:33.976228 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5ebfa48-d140-464a-8556-590a2666ce0c could not be found. May 25 16:30:33.976228 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:30:33.977776 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-07c62bc9-9ae0-49d0-80d0-f570d15d0970 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Returning 404 to user: Instance b5ebfa48-d140-464a-8556-590a2666ce0c could not be found. {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:30:33.977776 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-07c62bc9-9ae0-49d0-80d0-f570d15d0970 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c" status: 404 len: 111 microversion: 2.1 time: 0.030847 May 25 16:30:33.977776 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 524/1039] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:33 2022] GET /compute/v2.1/servers/b5ebfa48-d140-464a-8556-590a2666ce0c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:30:34.657427 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-fe6e7528-85b6-479c-b5d7-3543389e14fd tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:34.658393 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-fe6e7528-85b6-479c-b5d7-3543389e14fd tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:34.666055 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-fe6e7528-85b6-479c-b5d7-3543389e14fd tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:34.666762 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-fe6e7528-85b6-479c-b5d7-3543389e14fd tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:34.667756 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-fe6e7528-85b6-479c-b5d7-3543389e14fd tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:34.668392 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-fe6e7528-85b6-479c-b5d7-3543389e14fd tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:34.684338 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.wsgi [None req-fe6e7528-85b6-479c-b5d7-3543389e14fd tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] HTTP exception thrown: Instance c2ffa3b0-9de0-483c-86b7-0f18718d8760 could not be found. May 25 16:30:34.687009 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-fe6e7528-85b6-479c-b5d7-3543389e14fd tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Request method failure captured: May 25 16:30:34.687009 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: request: DELETE /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 HTTP/1.1 May 25 16:30:34.687009 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept: application/json May 25 16:30:34.687009 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept-Encoding: identity May 25 16:30:34.687009 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Connection: close May 25 16:30:34.687009 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Length: 0 May 25 16:30:34.687009 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Type: application/json May 25 16:30:34.687009 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Host: 10.222.0.42 May 25 16:30:34.687009 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Openstack-System-Scope: None May 25 16:30:34.687009 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: User-Agent: python-urllib3/1.26.9 May 25 16:30:34.687009 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Auth-Token: gAAAAABijlelzdsMf1DE_OJe4dAbolblNKTr5NJvI-0q9wR4ptTmYRXo7rIjfLWlJ8nvNyeHfiuhnvR9gWqRK6NHlHVGZOOk2Ahu15RsMbq4KZCpetI0YLeLWc9IC0N_3ktKyFVJ0plPOQzLQb0HgErkzSh6xF6AXOk6u3gHvA9r-zcV9P757SM May 25 16:30:34.687009 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Id: None May 25 16:30:34.687009 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Name: None May 25 16:30:34.687009 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Identity-Status: Confirmed May 25 16:30:34.687009 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Is-Admin-Project: True May 25 16:30:34.687009 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Id: default May 25 16:30:34.687009 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Name: Default May 25 16:30:34.687009 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Id: a40431f830294ea0a6395be072560dea May 25 16:30:34.687009 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Name: tempest-TestVolumeBootPattern-617412873 May 25 16:30:34.687009 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Role: reader,member May 25 16:30:34.687009 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Roles: reader,member May 25 16:30:34.688393 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a40431f830294ea0a6395be072560dea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a40431f830294ea0a6395be072560dea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a40431f830294ea0a6395be072560dea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a40431f830294ea0a6395be072560dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:30:34.688393 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant: tempest-TestVolumeBootPattern-617412873 May 25 16:30:34.688393 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Id: a40431f830294ea0a6395be072560dea May 25 16:30:34.688393 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Name: tempest-TestVolumeBootPattern-617412873 May 25 16:30:34.688393 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User: tempest-TestVolumeBootPattern-617412873-project May 25 16:30:34.688393 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Id: default May 25 16:30:34.688393 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Name: Default May 25 16:30:34.688393 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Id: c935f035c757482ca912a8c4b77714a0 May 25 16:30:34.688393 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Name: tempest-TestVolumeBootPattern-617412873-project May 25 16:30:34.688393 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: method: > May 25 16:30:34.688393 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: exception: Instance c2ffa3b0-9de0-483c-86b7-0f18718d8760 could not be found. May 25 16:30:34.688393 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: action_args: {'id': 'c2ffa3b0-9de0-483c-86b7-0f18718d8760'} May 25 16:30:34.689179 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:30:34.689179 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:30:34.689179 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:30:34.689179 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:30:34.689179 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:30:34.689179 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:30:34.689179 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:30:34.689179 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:30:34.689179 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:30:34.689179 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:30:34.689179 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2ffa3b0-9de0-483c-86b7-0f18718d8760 could not be found. May 25 16:30:34.689179 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:30:34.689179 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:30:34.689179 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:30:34.689179 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:30:34.689179 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:30:34.689179 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:30:34.689179 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:30:34.689179 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:30:34.689179 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:30:34.690496 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:30:34.690496 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 16:30:34.690496 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 16:30:34.690496 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 16:30:34.690496 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 16:30:34.690496 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:30:34.690496 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:30:34.690496 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:30:34.690496 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:30:34.690496 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2ffa3b0-9de0-483c-86b7-0f18718d8760 could not be found. May 25 16:30:34.690496 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:30:34.690496 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:30:34.690496 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:30:34.690496 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:30:34.690496 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:30:34.690496 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:30:34.690496 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:30:34.690496 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:30:34.690496 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2ffa3b0-9de0-483c-86b7-0f18718d8760 could not be found. May 25 16:30:34.690496 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:30:34.696090 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-fe6e7528-85b6-479c-b5d7-3543389e14fd tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Returning 404 to user: Instance c2ffa3b0-9de0-483c-86b7-0f18718d8760 could not be found. {{(pid=117510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:30:34.697473 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-fe6e7528-85b6-479c-b5d7-3543389e14fd tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760" status: 404 len: 111 microversion: 2.1 time: 0.044243 May 25 16:30:34.698276 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 516/1040] 10.222.0.42 () {58 vars in 1238 bytes} [Wed May 25 16:30:34 2022] DELETE /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:30:34.707071 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-524ebee4-3770-43a6-8238-f4b00f17c624 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:34.708407 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-524ebee4-3770-43a6-8238-f4b00f17c624 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] [instance: c2ffa3b0-9de0-483c-86b7-0f18718d8760] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:34.710942 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=3 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:30:34.716501 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-524ebee4-3770-43a6-8238-f4b00f17c624 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:34.717018 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-524ebee4-3770-43a6-8238-f4b00f17c624 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:34.718294 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-524ebee4-3770-43a6-8238-f4b00f17c624 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:34.718845 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-524ebee4-3770-43a6-8238-f4b00f17c624 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:34.735302 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.wsgi [None req-524ebee4-3770-43a6-8238-f4b00f17c624 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] HTTP exception thrown: Instance c2ffa3b0-9de0-483c-86b7-0f18718d8760 could not be found. May 25 16:30:34.736916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-524ebee4-3770-43a6-8238-f4b00f17c624 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Request method failure captured: May 25 16:30:34.736916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 HTTP/1.1 May 25 16:30:34.736916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:30:34.736916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:30:34.736916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:30:34.736916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 0 May 25 16:30:34.736916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:30:34.736916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:30:34.736916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:30:34.736916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:30:34.736916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijlelzdsMf1DE_OJe4dAbolblNKTr5NJvI-0q9wR4ptTmYRXo7rIjfLWlJ8nvNyeHfiuhnvR9gWqRK6NHlHVGZOOk2Ahu15RsMbq4KZCpetI0YLeLWc9IC0N_3ktKyFVJ0plPOQzLQb0HgErkzSh6xF6AXOk6u3gHvA9r-zcV9P757SM May 25 16:30:34.736916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:30:34.736916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:30:34.736916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:30:34.736916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:30:34.736916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:30:34.736916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:30:34.736916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: a40431f830294ea0a6395be072560dea May 25 16:30:34.736916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-TestVolumeBootPattern-617412873 May 25 16:30:34.736916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:30:34.736916 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:30:34.738631 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a40431f830294ea0a6395be072560dea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a40431f830294ea0a6395be072560dea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a40431f830294ea0a6395be072560dea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a40431f830294ea0a6395be072560dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:30:34.738631 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-TestVolumeBootPattern-617412873 May 25 16:30:34.738631 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: a40431f830294ea0a6395be072560dea May 25 16:30:34.738631 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-TestVolumeBootPattern-617412873 May 25 16:30:34.738631 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-TestVolumeBootPattern-617412873-project May 25 16:30:34.738631 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:30:34.738631 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:30:34.738631 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: c935f035c757482ca912a8c4b77714a0 May 25 16:30:34.738631 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-TestVolumeBootPattern-617412873-project May 25 16:30:34.738631 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: > May 25 16:30:34.738631 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Instance c2ffa3b0-9de0-483c-86b7-0f18718d8760 could not be found. May 25 16:30:34.738631 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'id': 'c2ffa3b0-9de0-483c-86b7-0f18718d8760'} May 25 16:30:34.739564 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:30:34.739564 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:30:34.739564 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:30:34.739564 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:30:34.739564 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:30:34.739564 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:30:34.739564 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:30:34.739564 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:30:34.739564 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:30:34.739564 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:30:34.739564 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2ffa3b0-9de0-483c-86b7-0f18718d8760 could not be found. May 25 16:30:34.739564 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:30:34.739564 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:30:34.739564 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:30:34.739564 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:30:34.739564 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:30:34.739564 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:30:34.739564 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:30:34.739564 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:30:34.739564 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:30:34.741051 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:30:34.741051 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:30:34.741051 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:30:34.741051 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:30:34.741051 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:30:34.741051 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:30:34.741051 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:30:34.741051 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2ffa3b0-9de0-483c-86b7-0f18718d8760 could not be found. May 25 16:30:34.741051 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:30:34.741051 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:30:34.741051 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:30:34.741051 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:30:34.741051 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:30:34.741051 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:30:34.741051 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:30:34.741051 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:30:34.741051 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2ffa3b0-9de0-483c-86b7-0f18718d8760 could not be found. May 25 16:30:34.741051 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:30:34.743171 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-524ebee4-3770-43a6-8238-f4b00f17c624 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Returning 404 to user: Instance c2ffa3b0-9de0-483c-86b7-0f18718d8760 could not be found. {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:30:34.744164 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-524ebee4-3770-43a6-8238-f4b00f17c624 tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760" status: 404 len: 111 microversion: 2.1 time: 0.041011 May 25 16:30:34.744901 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 525/1041] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:34 2022] GET /compute/v2.1/servers/c2ffa3b0-9de0-483c-86b7-0f18718d8760 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:30:34.760985 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-c1b78ec1-423f-4871-bd57-1828dcf0d687 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:34.761607 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-c1b78ec1-423f-4871-bd57-1828dcf0d687 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:34.768642 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c1b78ec1-423f-4871-bd57-1828dcf0d687 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:34.769310 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c1b78ec1-423f-4871-bd57-1828dcf0d687 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:34.770415 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c1b78ec1-423f-4871-bd57-1828dcf0d687 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:34.771016 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-c1b78ec1-423f-4871-bd57-1828dcf0d687 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:34.871038 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-0d2352a9-6677-4b8b-a6ed-262ef3f08a45 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:34.871532 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-0d2352a9-6677-4b8b-a6ed-262ef3f08a45 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: ea7289e9-fc54-4ad9-b784-32751344f97d] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:34.879049 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0d2352a9-6677-4b8b-a6ed-262ef3f08a45 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:34.879488 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0d2352a9-6677-4b8b-a6ed-262ef3f08a45 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:34.882333 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0d2352a9-6677-4b8b-a6ed-262ef3f08a45 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:34.883312 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0d2352a9-6677-4b8b-a6ed-262ef3f08a45 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:34.953171 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-0d2352a9-6677-4b8b-a6ed-262ef3f08a45 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d0cf08accf4a28b85ac2342d9c3023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6a5a6ae8b2488f8a5af6d2066fa88e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:34.961135 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-0d2352a9-6677-4b8b-a6ed-262ef3f08a45 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "GET /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d" status: 200 len: 1471 microversion: 2.1 time: 0.096462 May 25 16:30:34.961818 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 526/1042] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:34 2022] GET /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d => generated 1471 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:30:34.966637 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-600e645c-d7e8-4229-a9cf-a506283c463b req-8b8061e9-8083-4ceb-a274-7abbbd31ffd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea7289e9-fc54-4ad9-b784-32751344f97d", "name": "network-vif-deleted", "tag": "a7812a9c-7d68-49af-838a-93144c04d0d3"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:30:34.976675 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-600e645c-d7e8-4229-a9cf-a506283c463b req-8b8061e9-8083-4ceb-a274-7abbbd31ffd4 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:34.977237 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-600e645c-d7e8-4229-a9cf-a506283c463b req-8b8061e9-8083-4ceb-a274-7abbbd31ffd4 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:34.991039 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-600e645c-d7e8-4229-a9cf-a506283c463b req-8b8061e9-8083-4ceb-a274-7abbbd31ffd4 service nova] Creating event network-vif-deleted:a7812a9c-7d68-49af-838a-93144c04d0d3 for instance ea7289e9-fc54-4ad9-b784-32751344f97d on hv-cinder-84327 May 25 16:30:34.999556 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-600e645c-d7e8-4229-a9cf-a506283c463b req-8b8061e9-8083-4ceb-a274-7abbbd31ffd4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036167 May 25 16:30:35.000148 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 527/1043] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:30:35.110735 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-c1b78ec1-423f-4871-bd57-1828dcf0d687 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:35.118023 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-c1b78ec1-423f-4871-bd57-1828dcf0d687 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1261 microversion: 2.1 time: 0.361014 May 25 16:30:35.118579 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 517/1044] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:34 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1261 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:35.980001 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-8ade2e37-5d30-4dff-bd17-51b9808d32d3 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:35.981124 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-8ade2e37-5d30-4dff-bd17-51b9808d32d3 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: ea7289e9-fc54-4ad9-b784-32751344f97d] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:35.987975 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8ade2e37-5d30-4dff-bd17-51b9808d32d3 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:35.988722 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8ade2e37-5d30-4dff-bd17-51b9808d32d3 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:35.989909 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8ade2e37-5d30-4dff-bd17-51b9808d32d3 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:35.990719 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8ade2e37-5d30-4dff-bd17-51b9808d32d3 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:36.007907 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.wsgi [None req-8ade2e37-5d30-4dff-bd17-51b9808d32d3 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] HTTP exception thrown: Instance ea7289e9-fc54-4ad9-b784-32751344f97d could not be found. May 25 16:30:36.009601 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-8ade2e37-5d30-4dff-bd17-51b9808d32d3 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Request method failure captured: May 25 16:30:36.009601 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: GET /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d HTTP/1.1 May 25 16:30:36.009601 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:30:36.009601 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:30:36.009601 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:30:36.009601 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 0 May 25 16:30:36.009601 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:30:36.009601 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:30:36.009601 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:30:36.009601 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:30:36.009601 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijllrKquf1oPaIm3WPLFXQiRtikerrVtxBOLQpdGRxKlyFQ_tsXNpHyiFoogEEsrfQ3RisS2S5L2PWSDAZ3DyU1KNfMM6SbEDOQjhvfngVreegJq9krQr_Fvo0qRwKx4ki85Y_oSE5iP0Q680xXfGikecWsX0WpaOcMvHJHEM3Eae_j0 May 25 16:30:36.009601 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:30:36.009601 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:30:36.009601 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:30:36.009601 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:30:36.009601 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:30:36.009601 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:30:36.009601 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: 9f6a5a6ae8b2488f8a5af6d2066fa88e May 25 16:30:36.009601 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1211637136 May 25 16:30:36.009601 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:30:36.009601 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:30:36.011311 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9f6a5a6ae8b2488f8a5af6d2066fa88e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9f6a5a6ae8b2488f8a5af6d2066fa88e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9f6a5a6ae8b2488f8a5af6d2066fa88e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9f6a5a6ae8b2488f8a5af6d2066fa88e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:30:36.011311 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-VolumesSnapshotTestJSON-1211637136 May 25 16:30:36.011311 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: 9f6a5a6ae8b2488f8a5af6d2066fa88e May 25 16:30:36.011311 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1211637136 May 25 16:30:36.011311 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-VolumesSnapshotTestJSON-1211637136-project May 25 16:30:36.011311 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:30:36.011311 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:30:36.011311 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: 28d0cf08accf4a28b85ac2342d9c3023 May 25 16:30:36.011311 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-VolumesSnapshotTestJSON-1211637136-project May 25 16:30:36.011311 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: > May 25 16:30:36.011311 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Instance ea7289e9-fc54-4ad9-b784-32751344f97d could not be found. May 25 16:30:36.011311 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'id': 'ea7289e9-fc54-4ad9-b784-32751344f97d'} May 25 16:30:36.012433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:30:36.012433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:30:36.012433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:30:36.012433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:30:36.012433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:30:36.012433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:30:36.012433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:30:36.012433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:30:36.012433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:30:36.012433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:30:36.012433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea7289e9-fc54-4ad9-b784-32751344f97d could not be found. May 25 16:30:36.012433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:30:36.012433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:30:36.012433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:30:36.012433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:30:36.012433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:30:36.012433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:30:36.012433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:30:36.012433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:30:36.012433 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:30:36.014799 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:30:36.014799 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:30:36.014799 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:30:36.014799 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:30:36.014799 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:30:36.014799 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:30:36.014799 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:30:36.014799 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea7289e9-fc54-4ad9-b784-32751344f97d could not be found. May 25 16:30:36.014799 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:30:36.014799 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:30:36.014799 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:30:36.014799 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:30:36.014799 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:30:36.014799 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:30:36.014799 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:30:36.014799 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:30:36.014799 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea7289e9-fc54-4ad9-b784-32751344f97d could not be found. May 25 16:30:36.014799 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:30:36.016167 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-8ade2e37-5d30-4dff-bd17-51b9808d32d3 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Returning 404 to user: Instance ea7289e9-fc54-4ad9-b784-32751344f97d could not be found. {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:30:36.016167 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-8ade2e37-5d30-4dff-bd17-51b9808d32d3 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "GET /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d" status: 404 len: 111 microversion: 2.1 time: 0.035424 May 25 16:30:36.016911 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 528/1045] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:35 2022] GET /compute/v2.1/servers/ea7289e9-fc54-4ad9-b784-32751344f97d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:30:36.096332 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-428a5189-46e2-418c-b13e-0c3d8a767cda tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] Calling method '.version_select at 0x7f51ef526af0>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:36.144681 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-428a5189-46e2-418c-b13e-0c3d8a767cda tempest-TestVolumeBootPattern-617412873 tempest-TestVolumeBootPattern-617412873-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1857624386" status: 202 len: 0 microversion: 2.1 time: 0.052999 May 25 16:30:36.146202 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 518/1046] 10.222.0.42 () {58 vars in 1262 bytes} [Wed May 25 16:30:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1857624386 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:30:36.161845 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-53a6eee9-ff43-4b26-b16b-790f4ef03d5d tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:36.162674 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-53a6eee9-ff43-4b26-b16b-790f4ef03d5d tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:36.175654 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-53a6eee9-ff43-4b26-b16b-790f4ef03d5d tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:36.176526 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-53a6eee9-ff43-4b26-b16b-790f4ef03d5d tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:36.177483 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-53a6eee9-ff43-4b26-b16b-790f4ef03d5d tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:36.178894 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-53a6eee9-ff43-4b26-b16b-790f4ef03d5d tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:36.394932 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-f62a41ed-9f28-4be3-99fa-365112baea1e req-8e9bdecb-094d-4425-a454-9a29b68058bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67d74924-5509-4362-b314-27e375267a10", "name": "network-vif-plugged", "status": "completed", "tag": "0a1fd3e6-89fa-451b-a2f8-e586a9d6a09a"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:30:36.409334 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-f62a41ed-9f28-4be3-99fa-365112baea1e req-8e9bdecb-094d-4425-a454-9a29b68058bf service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:36.409861 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-f62a41ed-9f28-4be3-99fa-365112baea1e req-8e9bdecb-094d-4425-a454-9a29b68058bf service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:36.422887 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-f62a41ed-9f28-4be3-99fa-365112baea1e req-8e9bdecb-094d-4425-a454-9a29b68058bf service nova] Creating event network-vif-plugged:0a1fd3e6-89fa-451b-a2f8-e586a9d6a09a for instance 67d74924-5509-4362-b314-27e375267a10 on hv-cinder-84327 May 25 16:30:36.429789 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-f62a41ed-9f28-4be3-99fa-365112baea1e req-8e9bdecb-094d-4425-a454-9a29b68058bf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038388 May 25 16:30:36.431158 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 519/1047] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:30:36.870873 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-53a6eee9-ff43-4b26-b16b-790f4ef03d5d tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:36.879945 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-53a6eee9-ff43-4b26-b16b-790f4ef03d5d tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1261 microversion: 2.1 time: 0.747764 May 25 16:30:36.881951 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 529/1048] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:36 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1261 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:37.899838 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-0e2c6e78-ffb9-4c73-b2b6-e326dbbc79ce tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:37.900535 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-0e2c6e78-ffb9-4c73-b2b6-e326dbbc79ce tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:37.910016 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0e2c6e78-ffb9-4c73-b2b6-e326dbbc79ce tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:37.910757 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0e2c6e78-ffb9-4c73-b2b6-e326dbbc79ce tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:37.911681 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0e2c6e78-ffb9-4c73-b2b6-e326dbbc79ce tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:37.912409 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0e2c6e78-ffb9-4c73-b2b6-e326dbbc79ce tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:38.149408 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-0e2c6e78-ffb9-4c73-b2b6-e326dbbc79ce tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:38.157142 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-0e2c6e78-ffb9-4c73-b2b6-e326dbbc79ce tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1261 microversion: 2.1 time: 0.262130 May 25 16:30:38.158942 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 520/1049] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:37 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1261 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:39.174760 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-51767ff2-28f2-4c71-aff3-13679e32d3bc tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:39.175535 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-51767ff2-28f2-4c71-aff3-13679e32d3bc tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:39.187585 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-51767ff2-28f2-4c71-aff3-13679e32d3bc tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:39.188159 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-51767ff2-28f2-4c71-aff3-13679e32d3bc tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:39.189023 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-51767ff2-28f2-4c71-aff3-13679e32d3bc tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:39.189449 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-51767ff2-28f2-4c71-aff3-13679e32d3bc tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:39.445205 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-51767ff2-28f2-4c71-aff3-13679e32d3bc tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:39.458645 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-51767ff2-28f2-4c71-aff3-13679e32d3bc tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1261 microversion: 2.1 time: 0.287709 May 25 16:30:39.459487 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 530/1050] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:39 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1261 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:39.897960 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 16:30:39.901941 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Wed May 25 16:30:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 16:30:40.475663 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-88e74928-fad8-46ba-a2fd-8ababa7711ce tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:40.476285 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-88e74928-fad8-46ba-a2fd-8ababa7711ce tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:40.483853 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-88e74928-fad8-46ba-a2fd-8ababa7711ce tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:40.484559 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-88e74928-fad8-46ba-a2fd-8ababa7711ce tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:40.485346 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-88e74928-fad8-46ba-a2fd-8ababa7711ce tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:40.486075 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-88e74928-fad8-46ba-a2fd-8ababa7711ce tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:40.640374 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-88e74928-fad8-46ba-a2fd-8ababa7711ce tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:40.662123 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-88e74928-fad8-46ba-a2fd-8ababa7711ce tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1444 microversion: 2.1 time: 0.178971 May 25 16:30:40.662771 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 521/1051] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:40 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1444 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:40.680622 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-8beb6ad0-4376-4d56-8cdd-e833a79441f0 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:40.681240 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-8beb6ad0-4376-4d56-8cdd-e833a79441f0 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:40.688120 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8beb6ad0-4376-4d56-8cdd-e833a79441f0 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:40.688530 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8beb6ad0-4376-4d56-8cdd-e833a79441f0 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:40.689315 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8beb6ad0-4376-4d56-8cdd-e833a79441f0 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:40.690018 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-8beb6ad0-4376-4d56-8cdd-e833a79441f0 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:40.856472 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-8beb6ad0-4376-4d56-8cdd-e833a79441f0 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:40.868320 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-8beb6ad0-4376-4d56-8cdd-e833a79441f0 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1444 microversion: 2.1 time: 0.191601 May 25 16:30:40.870294 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 531/1052] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:40 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1444 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:43.228535 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-7abc1c43-c48a-4b5b-bc9a-95f39cb2483d req-8be54878-1eac-40e8-b12d-572a60c30797 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67d74924-5509-4362-b314-27e375267a10", "tag": "0a1fd3e6-89fa-451b-a2f8-e586a9d6a09a"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:30:43.233917 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:30:43.239923 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-7abc1c43-c48a-4b5b-bc9a-95f39cb2483d req-8be54878-1eac-40e8-b12d-572a60c30797 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:43.240373 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-7abc1c43-c48a-4b5b-bc9a-95f39cb2483d req-8be54878-1eac-40e8-b12d-572a60c30797 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:43.245408 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=100 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:30:43.261627 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-7abc1c43-c48a-4b5b-bc9a-95f39cb2483d req-8be54878-1eac-40e8-b12d-572a60c30797 service nova] Creating event network-changed:0a1fd3e6-89fa-451b-a2f8-e586a9d6a09a for instance 67d74924-5509-4362-b314-27e375267a10 on hv-cinder-84327 May 25 16:30:43.269363 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-7abc1c43-c48a-4b5b-bc9a-95f39cb2483d req-8be54878-1eac-40e8-b12d-572a60c30797 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046082 May 25 16:30:43.274142 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 522/1053] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:30:44.250314 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-55fc1a14-2da7-4ac0-be6e-8c3ab979dcca tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-363251210", "imageRef": "e74cccc1-cd1b-4dfc-8e47-3e4a832649a8", "flavorRef": "452", "networks": [{"uuid": "81d635de-5dd6-41b5-944e-480323c72862"}]}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:30:44.345207 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.network.neutron [None req-55fc1a14-2da7-4ac0-be6e-8c3ab979dcca tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] validate_networks() for [('81d635de-5dd6-41b5-944e-480323c72862', None, None, None, None, None)] {{(pid=117509) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:30:45.089157 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-55fc1a14-2da7-4ac0-be6e-8c3ab979dcca tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Flavor limits 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:30:45.089924 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-55fc1a14-2da7-4ac0-be6e-8c3ab979dcca tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Image limits 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:30:45.091050 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-55fc1a14-2da7-4ac0-be6e-8c3ab979dcca tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Flavor pref 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:30:45.091466 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-55fc1a14-2da7-4ac0-be6e-8c3ab979dcca tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Image pref 0:0:0 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:30:45.091883 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.virt.hardware [None req-55fc1a14-2da7-4ac0-be6e-8c3ab979dcca tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:30:45.102468 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-55fc1a14-2da7-4ac0-be6e-8c3ab979dcca tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:45.103188 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-55fc1a14-2da7-4ac0-be6e-8c3ab979dcca tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:45.104156 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-55fc1a14-2da7-4ac0-be6e-8c3ab979dcca tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:45.104894 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-55fc1a14-2da7-4ac0-be6e-8c3ab979dcca tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:45.131517 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-55fc1a14-2da7-4ac0-be6e-8c3ab979dcca tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Getting quotas for project 9f6a5a6ae8b2488f8a5af6d2066fa88e. Resources: {'ram', 'cores', 'instances'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:30:45.135867 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.quota [None req-55fc1a14-2da7-4ac0-be6e-8c3ab979dcca tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Getting quotas for user 28d0cf08accf4a28b85ac2342d9c3023 and project 9f6a5a6ae8b2488f8a5af6d2066fa88e. Resources: {'ram', 'cores', 'instances'} {{(pid=117509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:30:45.148272 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-55fc1a14-2da7-4ac0-be6e-8c3ab979dcca tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Going to run 1 instances... {{(pid=117509) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:30:45.150581 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-55fc1a14-2da7-4ac0-be6e-8c3ab979dcca tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: 54c81898-0775-4ff6-954e-376c4762b961] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e74cccc1-cd1b-4dfc-8e47-3e4a832649a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:30:45.199123 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-55fc1a14-2da7-4ac0-be6e-8c3ab979dcca tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.953640 May 25 16:30:45.200657 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 532/1054] 10.222.0.42 () {60 vars in 1146 bytes} [Wed May 25 16:30:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:30:45.213662 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-4bd3a9d1-2a3b-4d6c-86e9-c95c116e809a tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:45.214468 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-4bd3a9d1-2a3b-4d6c-86e9-c95c116e809a tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: 54c81898-0775-4ff6-954e-376c4762b961] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:45.340053 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-4bd3a9d1-2a3b-4d6c-86e9-c95c116e809a tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d0cf08accf4a28b85ac2342d9c3023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6a5a6ae8b2488f8a5af6d2066fa88e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:45.350023 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-4bd3a9d1-2a3b-4d6c-86e9-c95c116e809a tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961" status: 200 len: 1218 microversion: 2.1 time: 0.141188 May 25 16:30:45.350702 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 523/1055] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:45 2022] GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961 => generated 1218 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:46.367492 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-2d02068e-e260-488f-9394-c6c146ed15ae tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:46.368098 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-2d02068e-e260-488f-9394-c6c146ed15ae tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: 54c81898-0775-4ff6-954e-376c4762b961] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:46.375444 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2d02068e-e260-488f-9394-c6c146ed15ae tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:46.375887 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2d02068e-e260-488f-9394-c6c146ed15ae tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:46.376650 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2d02068e-e260-488f-9394-c6c146ed15ae tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:46.377078 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2d02068e-e260-488f-9394-c6c146ed15ae tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:46.460155 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-2d02068e-e260-488f-9394-c6c146ed15ae tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d0cf08accf4a28b85ac2342d9c3023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6a5a6ae8b2488f8a5af6d2066fa88e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:46.468996 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-2d02068e-e260-488f-9394-c6c146ed15ae tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961" status: 200 len: 1278 microversion: 2.1 time: 0.105352 May 25 16:30:46.469558 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 533/1056] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:46 2022] GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961 => generated 1278 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:47.486785 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-9c343311-1c0f-49ef-91bb-de12868137df tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:47.487429 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-9c343311-1c0f-49ef-91bb-de12868137df tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: 54c81898-0775-4ff6-954e-376c4762b961] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:47.494889 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9c343311-1c0f-49ef-91bb-de12868137df tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:47.495338 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9c343311-1c0f-49ef-91bb-de12868137df tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:47.496113 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9c343311-1c0f-49ef-91bb-de12868137df tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:47.496553 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-9c343311-1c0f-49ef-91bb-de12868137df tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:47.691900 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-9c343311-1c0f-49ef-91bb-de12868137df tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d0cf08accf4a28b85ac2342d9c3023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6a5a6ae8b2488f8a5af6d2066fa88e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:47.699210 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-9c343311-1c0f-49ef-91bb-de12868137df tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961" status: 200 len: 1318 microversion: 2.1 time: 0.216332 May 25 16:30:47.699785 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 524/1057] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:47 2022] GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:30:47.765163 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-c45ecc7b-bb59-4254-9e59-aec2d1326f39 req-da78ae10-dbb1-46e5-a1cb-b15c38c6dc6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54c81898-0775-4ff6-954e-376c4762b961", "tag": "0f8cdae4-3f59-4856-b865-88fd1b2023dc"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:30:47.778797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-c45ecc7b-bb59-4254-9e59-aec2d1326f39 req-da78ae10-dbb1-46e5-a1cb-b15c38c6dc6b service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:47.779246 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-c45ecc7b-bb59-4254-9e59-aec2d1326f39 req-da78ae10-dbb1-46e5-a1cb-b15c38c6dc6b service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:47.790892 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-c45ecc7b-bb59-4254-9e59-aec2d1326f39 req-da78ae10-dbb1-46e5-a1cb-b15c38c6dc6b service nova] Creating event network-changed:0f8cdae4-3f59-4856-b865-88fd1b2023dc for instance 54c81898-0775-4ff6-954e-376c4762b961 on hv-cinder-84327 May 25 16:30:47.796272 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-c45ecc7b-bb59-4254-9e59-aec2d1326f39 req-da78ae10-dbb1-46e5-a1cb-b15c38c6dc6b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035019 May 25 16:30:47.796841 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 534/1058] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:30:48.717235 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-5d393b40-8376-4aac-aea7-e404c3317f79 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:48.717790 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-5d393b40-8376-4aac-aea7-e404c3317f79 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: 54c81898-0775-4ff6-954e-376c4762b961] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:48.724162 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5d393b40-8376-4aac-aea7-e404c3317f79 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:48.724602 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5d393b40-8376-4aac-aea7-e404c3317f79 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:48.725358 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5d393b40-8376-4aac-aea7-e404c3317f79 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:48.725817 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-5d393b40-8376-4aac-aea7-e404c3317f79 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:48.855879 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-5d393b40-8376-4aac-aea7-e404c3317f79 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d0cf08accf4a28b85ac2342d9c3023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6a5a6ae8b2488f8a5af6d2066fa88e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:48.864176 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-5d393b40-8376-4aac-aea7-e404c3317f79 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961" status: 200 len: 1318 microversion: 2.1 time: 0.151715 May 25 16:30:48.864744 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 525/1059] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:48 2022] GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:49.881271 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-919855f7-fc60-4ca7-9852-35cd1e5b3d3b tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:49.881987 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-919855f7-fc60-4ca7-9852-35cd1e5b3d3b tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: 54c81898-0775-4ff6-954e-376c4762b961] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:49.888193 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-919855f7-fc60-4ca7-9852-35cd1e5b3d3b tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:49.888633 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-919855f7-fc60-4ca7-9852-35cd1e5b3d3b tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:49.889386 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-919855f7-fc60-4ca7-9852-35cd1e5b3d3b tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:49.889918 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-919855f7-fc60-4ca7-9852-35cd1e5b3d3b tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:50.018953 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-919855f7-fc60-4ca7-9852-35cd1e5b3d3b tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d0cf08accf4a28b85ac2342d9c3023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6a5a6ae8b2488f8a5af6d2066fa88e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:50.026371 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-919855f7-fc60-4ca7-9852-35cd1e5b3d3b tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961" status: 200 len: 1318 microversion: 2.1 time: 0.149796 May 25 16:30:50.026939 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 535/1060] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:49 2022] GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:51.044734 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-f56443a0-33df-4047-973b-40945ccdae2d tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:51.045349 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-f56443a0-33df-4047-973b-40945ccdae2d tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: 54c81898-0775-4ff6-954e-376c4762b961] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:51.051801 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f56443a0-33df-4047-973b-40945ccdae2d tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:51.052252 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f56443a0-33df-4047-973b-40945ccdae2d tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:51.053012 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f56443a0-33df-4047-973b-40945ccdae2d tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:51.053444 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f56443a0-33df-4047-973b-40945ccdae2d tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:51.183612 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-f56443a0-33df-4047-973b-40945ccdae2d tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d0cf08accf4a28b85ac2342d9c3023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6a5a6ae8b2488f8a5af6d2066fa88e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:51.191218 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-f56443a0-33df-4047-973b-40945ccdae2d tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961" status: 200 len: 1318 microversion: 2.1 time: 0.151054 May 25 16:30:51.191790 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 526/1061] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:51 2022] GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:52.208298 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-da8f8df4-b4ed-49d1-b019-903e32b57485 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:52.209191 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-da8f8df4-b4ed-49d1-b019-903e32b57485 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: 54c81898-0775-4ff6-954e-376c4762b961] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:52.216361 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-da8f8df4-b4ed-49d1-b019-903e32b57485 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:52.216811 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-da8f8df4-b4ed-49d1-b019-903e32b57485 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:52.217599 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-da8f8df4-b4ed-49d1-b019-903e32b57485 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:52.218061 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-da8f8df4-b4ed-49d1-b019-903e32b57485 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:52.347405 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-da8f8df4-b4ed-49d1-b019-903e32b57485 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d0cf08accf4a28b85ac2342d9c3023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6a5a6ae8b2488f8a5af6d2066fa88e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:52.355007 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-da8f8df4-b4ed-49d1-b019-903e32b57485 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961" status: 200 len: 1318 microversion: 2.1 time: 0.150587 May 25 16:30:52.355678 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 536/1062] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:52 2022] GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:53.372359 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-3d259ae0-5579-43ca-9dd2-84263e6c3b6c tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:53.372996 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-3d259ae0-5579-43ca-9dd2-84263e6c3b6c tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: 54c81898-0775-4ff6-954e-376c4762b961] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:53.379517 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3d259ae0-5579-43ca-9dd2-84263e6c3b6c tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:53.379968 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3d259ae0-5579-43ca-9dd2-84263e6c3b6c tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:53.380724 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3d259ae0-5579-43ca-9dd2-84263e6c3b6c tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:53.381162 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3d259ae0-5579-43ca-9dd2-84263e6c3b6c tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:53.509437 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-3d259ae0-5579-43ca-9dd2-84263e6c3b6c tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d0cf08accf4a28b85ac2342d9c3023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6a5a6ae8b2488f8a5af6d2066fa88e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:53.517451 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-3d259ae0-5579-43ca-9dd2-84263e6c3b6c tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961" status: 200 len: 1318 microversion: 2.1 time: 0.149185 May 25 16:30:53.518062 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 527/1063] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:53 2022] GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:54.394423 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-8aac6a75-ccaa-4cd1-804e-f264533e633b req-c29f08f4-0188-4e5e-a925-3c000166a1d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c81898-0775-4ff6-954e-376c4762b961", "name": "network-vif-plugged", "status": "completed", "tag": "0f8cdae4-3f59-4856-b865-88fd1b2023dc"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:30:54.403918 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-8aac6a75-ccaa-4cd1-804e-f264533e633b req-c29f08f4-0188-4e5e-a925-3c000166a1d2 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:54.404363 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-8aac6a75-ccaa-4cd1-804e-f264533e633b req-c29f08f4-0188-4e5e-a925-3c000166a1d2 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:54.415624 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-8aac6a75-ccaa-4cd1-804e-f264533e633b req-c29f08f4-0188-4e5e-a925-3c000166a1d2 service nova] Creating event network-vif-plugged:0f8cdae4-3f59-4856-b865-88fd1b2023dc for instance 54c81898-0775-4ff6-954e-376c4762b961 on hv-cinder-84327 May 25 16:30:54.421249 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-8aac6a75-ccaa-4cd1-804e-f264533e633b req-c29f08f4-0188-4e5e-a925-3c000166a1d2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030547 May 25 16:30:54.421868 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 537/1064] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:30:54.534837 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-b20667ee-21fa-4a98-995e-e961fde3f57a tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:54.535380 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-b20667ee-21fa-4a98-995e-e961fde3f57a tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: 54c81898-0775-4ff6-954e-376c4762b961] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:54.542231 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b20667ee-21fa-4a98-995e-e961fde3f57a tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:54.542679 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b20667ee-21fa-4a98-995e-e961fde3f57a tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:54.543554 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b20667ee-21fa-4a98-995e-e961fde3f57a tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:54.544502 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b20667ee-21fa-4a98-995e-e961fde3f57a tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:54.723940 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-b20667ee-21fa-4a98-995e-e961fde3f57a tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d0cf08accf4a28b85ac2342d9c3023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6a5a6ae8b2488f8a5af6d2066fa88e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:54.731784 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-b20667ee-21fa-4a98-995e-e961fde3f57a tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961" status: 200 len: 1318 microversion: 2.1 time: 0.200328 May 25 16:30:54.732570 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 528/1065] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:54 2022] GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:55.746143 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell0:SELECT=2 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:30:55.747882 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell0:SELECT=6 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:30:55.752984 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-48b440d6-d367-4c67-9fce-40fc2044d4ed tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:55.753980 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-48b440d6-d367-4c67-9fce-40fc2044d4ed tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: 54c81898-0775-4ff6-954e-376c4762b961] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:55.761696 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-48b440d6-d367-4c67-9fce-40fc2044d4ed tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:55.762324 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-48b440d6-d367-4c67-9fce-40fc2044d4ed tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:55.763304 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-48b440d6-d367-4c67-9fce-40fc2044d4ed tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:55.763742 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-48b440d6-d367-4c67-9fce-40fc2044d4ed tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:55.900541 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-48b440d6-d367-4c67-9fce-40fc2044d4ed tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d0cf08accf4a28b85ac2342d9c3023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6a5a6ae8b2488f8a5af6d2066fa88e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:55.908964 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-48b440d6-d367-4c67-9fce-40fc2044d4ed tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961" status: 200 len: 1318 microversion: 2.1 time: 0.164130 May 25 16:30:55.909581 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 538/1066] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:55 2022] GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:56.927053 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-49def6b8-2361-4301-8434-a52cbe76709e tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:30:56.927655 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-49def6b8-2361-4301-8434-a52cbe76709e tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: 54c81898-0775-4ff6-954e-376c4762b961] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:56.929879 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell0:SELECT=2 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:30:56.936564 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-49def6b8-2361-4301-8434-a52cbe76709e tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:56.937008 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-49def6b8-2361-4301-8434-a52cbe76709e tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:56.937798 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-49def6b8-2361-4301-8434-a52cbe76709e tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:56.938237 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-49def6b8-2361-4301-8434-a52cbe76709e tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:57.071377 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-49def6b8-2361-4301-8434-a52cbe76709e tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d0cf08accf4a28b85ac2342d9c3023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6a5a6ae8b2488f8a5af6d2066fa88e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:30:57.078865 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-49def6b8-2361-4301-8434-a52cbe76709e tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961" status: 200 len: 1506 microversion: 2.1 time: 0.155820 May 25 16:30:57.079423 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 529/1067] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:30:56 2022] GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:30:57.095673 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-0671a1ed-b209-4202-9240-345db84c8c92 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8ad927e-8186-4319-8606-4d055d9fe694", "device": "/dev/sdb"}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:30:57.096865 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-0671a1ed-b209-4202-9240-345db84c8c92 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: 54c81898-0775-4ff6-954e-376c4762b961] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:30:57.103797 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0671a1ed-b209-4202-9240-345db84c8c92 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:57.104316 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0671a1ed-b209-4202-9240-345db84c8c92 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:57.105336 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0671a1ed-b209-4202-9240-345db84c8c92 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:30:57.106382 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0671a1ed-b209-4202-9240-345db84c8c92 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:30:57.343177 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-0671a1ed-b209-4202-9240-345db84c8c92 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "POST /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251675 May 25 16:30:57.343766 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 539/1068] 10.222.0.42 () {60 vars in 1322 bytes} [Wed May 25 16:30:57 2022] POST /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:31:12.274873 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-51a767c5-b7a8-44c5-aced-f33fb77f1e59 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-574722537"}} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:31:12.275420 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-51a767c5-b7a8-44c5-aced-f33fb77f1e59 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:31:12.277320 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_api:SELECT=17 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:31:12.278703 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=36 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:31:12.285509 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-51a767c5-b7a8-44c5-aced-f33fb77f1e59 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:12.286289 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-51a767c5-b7a8-44c5-aced-f33fb77f1e59 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:12.287498 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-51a767c5-b7a8-44c5-aced-f33fb77f1e59 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:12.288234 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-51a767c5-b7a8-44c5-aced-f33fb77f1e59 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:12.421668 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.network.security_group_api [None req-51a767c5-b7a8-44c5-aced-f33fb77f1e59 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Removing security group 112fb6f1-635e-4d28-bb0d-83a601a813d5 from port 0bc5d294-6526-41f2-a874-eb5b98d8279f May 25 16:31:12.802207 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-51a767c5-b7a8-44c5-aced-f33fb77f1e59 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "POST /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315/action" status: 202 len: 0 microversion: 2.1 time: 0.531554 May 25 16:31:12.803052 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 530/1069] 10.222.0.42 () {60 vars in 1277 bytes} [Wed May 25 16:31:12 2022] POST /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315/action => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:31:12.822146 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:31:12.823130 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=89,nova_cell1:INSERT=2 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:31:13.114313 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-49bfd3d2-1f24-4416-8e27-5fd8a0106fc1 req-41a075ba-5bcb-462e-a77a-1fc95c33c7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11516011-7294-415c-9637-27fe37077315", "tag": "0bc5d294-6526-41f2-a874-eb5b98d8279f"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:31:13.126450 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-49bfd3d2-1f24-4416-8e27-5fd8a0106fc1 req-41a075ba-5bcb-462e-a77a-1fc95c33c7f3 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:13.126899 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-49bfd3d2-1f24-4416-8e27-5fd8a0106fc1 req-41a075ba-5bcb-462e-a77a-1fc95c33c7f3 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:13.138669 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-49bfd3d2-1f24-4416-8e27-5fd8a0106fc1 req-41a075ba-5bcb-462e-a77a-1fc95c33c7f3 service nova] Creating event network-changed:0bc5d294-6526-41f2-a874-eb5b98d8279f for instance 11516011-7294-415c-9637-27fe37077315 on hv-cinder-84327 May 25 16:31:13.144111 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-49bfd3d2-1f24-4416-8e27-5fd8a0106fc1 req-41a075ba-5bcb-462e-a77a-1fc95c33c7f3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.335676 May 25 16:31:13.145060 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 540/1070] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:31:14.539685 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-b81bdf14-fae5-40da-8102-e6683f521ad2 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:31:14.540491 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-b81bdf14-fae5-40da-8102-e6683f521ad2 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:31:14.547410 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b81bdf14-fae5-40da-8102-e6683f521ad2 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:14.548072 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b81bdf14-fae5-40da-8102-e6683f521ad2 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:14.548848 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b81bdf14-fae5-40da-8102-e6683f521ad2 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:14.549278 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b81bdf14-fae5-40da-8102-e6683f521ad2 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:14.645295 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.objects.instance [None req-b81bdf14-fae5-40da-8102-e6683f521ad2 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lazy-loading 'services' on Instance uuid 11516011-7294-415c-9637-27fe37077315 {{(pid=117510) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:31:14.724517 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-b81bdf14-fae5-40da-8102-e6683f521ad2 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "DELETE /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315/os-volume_attachments/04bce330-9df3-4db3-9333-93843f848820" status: 202 len: 0 microversion: 2.1 time: 0.188659 May 25 16:31:14.728354 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 531/1071] 10.222.0.42 () {58 vars in 1415 bytes} [Wed May 25 16:31:14 2022] DELETE /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315/os-volume_attachments/04bce330-9df3-4db3-9333-93843f848820 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:31:14.735305 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-5eb21de0-25cb-4f88-b46d-82049c080949 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:31:14.737015 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-5eb21de0-25cb-4f88-b46d-82049c080949 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:31:14.745798 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5eb21de0-25cb-4f88-b46d-82049c080949 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:14.746900 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5eb21de0-25cb-4f88-b46d-82049c080949 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:14.747685 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5eb21de0-25cb-4f88-b46d-82049c080949 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:14.748123 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5eb21de0-25cb-4f88-b46d-82049c080949 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:14.786023 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-5eb21de0-25cb-4f88-b46d-82049c080949 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055883 May 25 16:31:14.787238 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 541/1072] 10.222.0.42 () {58 vars in 1301 bytes} [Wed May 25 16:31:14 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:31:15.166127 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-8c6af825-113d-4df6-8012-32c06b1d0bc8 req-94a00da1-f5b0-4699-9dff-5c867aeed921 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11516011-7294-415c-9637-27fe37077315", "tag": "0bc5d294-6526-41f2-a874-eb5b98d8279f"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:31:15.174891 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-8c6af825-113d-4df6-8012-32c06b1d0bc8 req-94a00da1-f5b0-4699-9dff-5c867aeed921 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:15.175335 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-8c6af825-113d-4df6-8012-32c06b1d0bc8 req-94a00da1-f5b0-4699-9dff-5c867aeed921 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:15.186420 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-8c6af825-113d-4df6-8012-32c06b1d0bc8 req-94a00da1-f5b0-4699-9dff-5c867aeed921 service nova] Creating event network-changed:0bc5d294-6526-41f2-a874-eb5b98d8279f for instance 11516011-7294-415c-9637-27fe37077315 on hv-cinder-84327 May 25 16:31:15.191146 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-8c6af825-113d-4df6-8012-32c06b1d0bc8 req-94a00da1-f5b0-4699-9dff-5c867aeed921 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029392 May 25 16:31:15.191834 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 532/1073] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:31:15.647485 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-0f908856-4a8a-4834-9781-0aeb4d7b60d0 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:31:15.647985 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-0f908856-4a8a-4834-9781-0aeb4d7b60d0 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: 54c81898-0775-4ff6-954e-376c4762b961] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:31:15.654963 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0f908856-4a8a-4834-9781-0aeb4d7b60d0 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:15.655413 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0f908856-4a8a-4834-9781-0aeb4d7b60d0 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:15.656182 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0f908856-4a8a-4834-9781-0aeb4d7b60d0 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:15.656621 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-0f908856-4a8a-4834-9781-0aeb4d7b60d0 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:15.742893 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.objects.instance [None req-0f908856-4a8a-4834-9781-0aeb4d7b60d0 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lazy-loading 'services' on Instance uuid 54c81898-0775-4ff6-954e-376c4762b961 {{(pid=117509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:31:15.800681 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-44fd54b0-fc4a-4272-a116-8d0ae7ec831c tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:31:15.802129 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-44fd54b0-fc4a-4272-a116-8d0ae7ec831c tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:31:15.808838 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-44fd54b0-fc4a-4272-a116-8d0ae7ec831c tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:15.810178 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-44fd54b0-fc4a-4272-a116-8d0ae7ec831c tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:15.810953 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-44fd54b0-fc4a-4272-a116-8d0ae7ec831c tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:15.811382 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-44fd54b0-fc4a-4272-a116-8d0ae7ec831c tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:15.821899 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-0f908856-4a8a-4834-9781-0aeb4d7b60d0 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "DELETE /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961/os-volume_attachments/e8ad927e-8186-4319-8606-4d055d9fe694" status: 202 len: 0 microversion: 2.1 time: 0.178163 May 25 16:31:15.822887 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 542/1074] 10.222.0.42 () {58 vars in 1415 bytes} [Wed May 25 16:31:15 2022] DELETE /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961/os-volume_attachments/e8ad927e-8186-4319-8606-4d055d9fe694 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:31:15.846826 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-44fd54b0-fc4a-4272-a116-8d0ae7ec831c tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051117 May 25 16:31:15.847675 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 533/1075] 10.222.0.42 () {58 vars in 1301 bytes} [Wed May 25 16:31:15 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 16:31:15.859225 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-9aad0afd-7ef9-416f-a933-2ebc9a6fd306 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:31:15.859814 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-9aad0afd-7ef9-416f-a933-2ebc9a6fd306 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:31:15.866453 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9aad0afd-7ef9-416f-a933-2ebc9a6fd306 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:15.866987 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9aad0afd-7ef9-416f-a933-2ebc9a6fd306 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:15.867914 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9aad0afd-7ef9-416f-a933-2ebc9a6fd306 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:15.868423 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-9aad0afd-7ef9-416f-a933-2ebc9a6fd306 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:15.945980 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.wsgi [None req-9aad0afd-7ef9-416f-a933-2ebc9a6fd306 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] HTTP exception thrown: Instance 11516011-7294-415c-9637-27fe37077315 is not attached to volume 04bce330-9df3-4db3-9333-93843f848820 May 25 16:31:15.948324 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-9aad0afd-7ef9-416f-a933-2ebc9a6fd306 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Request method failure captured: May 25 16:31:15.948324 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: DELETE /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315/os-volume_attachments/04bce330-9df3-4db3-9333-93843f848820 HTTP/1.1 May 25 16:31:15.948324 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:31:15.948324 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:31:15.948324 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:31:15.948324 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 0 May 25 16:31:15.948324 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:31:15.948324 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:31:15.948324 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:31:15.948324 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:31:15.948324 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijllBQRBwHb-Dhf36wa0E7fEJJAoN5NhqcYkzaqtTeRXdDDk6ievZduFyhQZuQM0dUmRLBToo9Wugv_meHoSYXoEfrNN8PznVMw50YuxrXVDrYNSIumn5O8rYB1Mi___03v59awuYHFAH4mGkLemBIMPAxXazZgOvvfpVJmuHWG3CaYQ May 25 16:31:15.948324 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:31:15.948324 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:31:15.948324 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:31:15.948324 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:31:15.948324 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:31:15.948324 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:31:15.948324 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: c8efc0621a1242329970cda13b3fee4b May 25 16:31:15.948324 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-TestMinimumBasicScenario-908225847 May 25 16:31:15.948324 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:31:15.948324 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:31:15.951110 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c8efc0621a1242329970cda13b3fee4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c8efc0621a1242329970cda13b3fee4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c8efc0621a1242329970cda13b3fee4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c8efc0621a1242329970cda13b3fee4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:31:15.951110 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-TestMinimumBasicScenario-908225847 May 25 16:31:15.951110 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: c8efc0621a1242329970cda13b3fee4b May 25 16:31:15.951110 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-TestMinimumBasicScenario-908225847 May 25 16:31:15.951110 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-TestMinimumBasicScenario-908225847-project May 25 16:31:15.951110 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:31:15.951110 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:31:15.951110 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: fcca87cd01ae464cb1484c3bbd52aaf6 May 25 16:31:15.951110 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-TestMinimumBasicScenario-908225847-project May 25 16:31:15.951110 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: > May 25 16:31:15.951110 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Instance 11516011-7294-415c-9637-27fe37077315 is not attached to volume 04bce330-9df3-4db3-9333-93843f848820 May 25 16:31:15.952219 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'server_id': '11516011-7294-415c-9637-27fe37077315', 'id': '04bce330-9df3-4db3-9333-93843f848820'} May 25 16:31:15.952219 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:31:15.952219 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:31:15.952219 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 25 16:31:15.952219 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 25 16:31:15.952219 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 16:31:15.952219 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 16:31:15.952219 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 25 16:31:15.952219 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 25 16:31:15.952219 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 04bce330-9df3-4db3-9333-93843f848820. May 25 16:31:15.952219 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:31:15.952219 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:31:15.952219 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:31:15.952219 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:31:15.952219 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:31:15.952219 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:31:15.952219 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:31:15.952219 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:31:15.952219 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:31:15.954268 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:31:15.954268 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 25 16:31:15.954268 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 25 16:31:15.954268 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11516011-7294-415c-9637-27fe37077315 is not attached to volume 04bce330-9df3-4db3-9333-93843f848820 May 25 16:31:15.954268 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:31:15.954268 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:31:15.954268 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:31:15.954268 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:31:15.954268 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:31:15.954268 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:31:15.954268 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:31:15.954268 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:31:15.954268 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11516011-7294-415c-9637-27fe37077315 is not attached to volume 04bce330-9df3-4db3-9333-93843f848820 May 25 16:31:15.954268 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:31:15.954268 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-9aad0afd-7ef9-416f-a933-2ebc9a6fd306 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Returning 404 to user: Instance 11516011-7294-415c-9637-27fe37077315 is not attached to volume 04bce330-9df3-4db3-9333-93843f848820 {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:31:15.955697 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-9aad0afd-7ef9-416f-a933-2ebc9a6fd306 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "DELETE /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315/os-volume_attachments/04bce330-9df3-4db3-9333-93843f848820" status: 404 len: 154 microversion: 2.1 time: 0.096445 May 25 16:31:15.955697 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 543/1076] 10.222.0.42 () {58 vars in 1415 bytes} [Wed May 25 16:31:15 2022] DELETE /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315/os-volume_attachments/04bce330-9df3-4db3-9333-93843f848820 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:31:16.942474 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-a2a506d8-5695-4d2b-95c0-1b1fba048940 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:31:16.943001 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-a2a506d8-5695-4d2b-95c0-1b1fba048940 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: 54c81898-0775-4ff6-954e-376c4762b961] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:31:16.949475 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a2a506d8-5695-4d2b-95c0-1b1fba048940 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:16.950114 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a2a506d8-5695-4d2b-95c0-1b1fba048940 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:16.950884 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a2a506d8-5695-4d2b-95c0-1b1fba048940 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:16.951322 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-a2a506d8-5695-4d2b-95c0-1b1fba048940 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:16.975936 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-a2a506d8-5695-4d2b-95c0-1b1fba048940 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: 54c81898-0775-4ff6-954e-376c4762b961] Going to try to terminate instance {{(pid=117510) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:31:17.053352 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-a2a506d8-5695-4d2b-95c0-1b1fba048940 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "DELETE /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961" status: 204 len: 0 microversion: 2.1 time: 0.114204 May 25 16:31:17.054306 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 534/1077] 10.222.0.42 () {58 vars in 1238 bytes} [Wed May 25 16:31:16 2022] DELETE /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:31:17.064819 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-1e26d621-29fb-424b-80ea-b170bc8fc914 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:31:17.065495 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-1e26d621-29fb-424b-80ea-b170bc8fc914 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: 54c81898-0775-4ff6-954e-376c4762b961] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:31:17.073391 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1e26d621-29fb-424b-80ea-b170bc8fc914 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:17.073880 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1e26d621-29fb-424b-80ea-b170bc8fc914 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:17.074749 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1e26d621-29fb-424b-80ea-b170bc8fc914 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:17.075184 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1e26d621-29fb-424b-80ea-b170bc8fc914 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:17.087200 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-7a6f6736-428a-4edb-80f5-73b674b3106f tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:31:17.087777 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-7a6f6736-428a-4edb-80f5-73b674b3106f tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:31:17.094422 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7a6f6736-428a-4edb-80f5-73b674b3106f tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:17.094860 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7a6f6736-428a-4edb-80f5-73b674b3106f tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:17.095619 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7a6f6736-428a-4edb-80f5-73b674b3106f tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:17.096047 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7a6f6736-428a-4edb-80f5-73b674b3106f tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:17.121871 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-7a6f6736-428a-4edb-80f5-73b674b3106f tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Going to try to terminate instance {{(pid=117510) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:31:17.197614 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-7a6f6736-428a-4edb-80f5-73b674b3106f tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "DELETE /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 204 len: 0 microversion: 2.1 time: 0.114276 May 25 16:31:17.198228 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 535/1078] 10.222.0.42 () {58 vars in 1238 bytes} [Wed May 25 16:31:17 2022] DELETE /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:31:17.207342 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-2135338b-2f46-41e4-8a3c-208cdbf3d6cf tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:31:17.208027 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-2135338b-2f46-41e4-8a3c-208cdbf3d6cf tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:31:17.213611 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2135338b-2f46-41e4-8a3c-208cdbf3d6cf tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:17.214086 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2135338b-2f46-41e4-8a3c-208cdbf3d6cf tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:17.215398 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2135338b-2f46-41e4-8a3c-208cdbf3d6cf tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:17.216125 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-2135338b-2f46-41e4-8a3c-208cdbf3d6cf tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:17.216624 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-1e26d621-29fb-424b-80ea-b170bc8fc914 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d0cf08accf4a28b85ac2342d9c3023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6a5a6ae8b2488f8a5af6d2066fa88e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:31:17.224161 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-1e26d621-29fb-424b-80ea-b170bc8fc914 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961" status: 200 len: 1512 microversion: 2.1 time: 0.163761 May 25 16:31:17.224740 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 544/1079] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:31:17 2022] GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961 => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:31:17.350359 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-2135338b-2f46-41e4-8a3c-208cdbf3d6cf tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:31:17.357797 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-2135338b-2f46-41e4-8a3c-208cdbf3d6cf tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1554 microversion: 2.1 time: 0.154399 May 25 16:31:17.358362 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 536/1080] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:31:17 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:31:18.242050 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-f03573f9-2db6-4671-9c89-7b986e9f45bd tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:31:18.242593 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-f03573f9-2db6-4671-9c89-7b986e9f45bd tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: 54c81898-0775-4ff6-954e-376c4762b961] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:31:18.249773 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f03573f9-2db6-4671-9c89-7b986e9f45bd tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:18.250228 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f03573f9-2db6-4671-9c89-7b986e9f45bd tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:18.250991 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f03573f9-2db6-4671-9c89-7b986e9f45bd tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:18.251429 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f03573f9-2db6-4671-9c89-7b986e9f45bd tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:18.376836 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-e46c41e1-9b0f-4947-8ad3-455a983204ab tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:31:18.378980 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-e46c41e1-9b0f-4947-8ad3-455a983204ab tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:31:18.385076 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e46c41e1-9b0f-4947-8ad3-455a983204ab tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:18.386286 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e46c41e1-9b0f-4947-8ad3-455a983204ab tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:18.387280 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e46c41e1-9b0f-4947-8ad3-455a983204ab tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:18.387850 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-e46c41e1-9b0f-4947-8ad3-455a983204ab tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:18.388626 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-f03573f9-2db6-4671-9c89-7b986e9f45bd tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d0cf08accf4a28b85ac2342d9c3023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6a5a6ae8b2488f8a5af6d2066fa88e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:31:18.397319 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-f03573f9-2db6-4671-9c89-7b986e9f45bd tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961" status: 200 len: 1512 microversion: 2.1 time: 0.159312 May 25 16:31:18.397940 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 545/1081] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:31:18 2022] GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:31:18.518592 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-e46c41e1-9b0f-4947-8ad3-455a983204ab tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:31:18.526033 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-e46c41e1-9b0f-4947-8ad3-455a983204ab tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1554 microversion: 2.1 time: 0.153287 May 25 16:31:18.526595 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 537/1082] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:31:18 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:31:19.414114 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-3738016f-3c41-4929-bd66-d91a9924f826 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:31:19.414713 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-3738016f-3c41-4929-bd66-d91a9924f826 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: 54c81898-0775-4ff6-954e-376c4762b961] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:31:19.421601 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3738016f-3c41-4929-bd66-d91a9924f826 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:19.422069 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3738016f-3c41-4929-bd66-d91a9924f826 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:19.422815 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3738016f-3c41-4929-bd66-d91a9924f826 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:19.423239 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-3738016f-3c41-4929-bd66-d91a9924f826 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:19.544651 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-4b7ea097-73f4-40e5-bf3e-e23b1343cc40 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:31:19.545290 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-4b7ea097-73f4-40e5-bf3e-e23b1343cc40 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:31:19.551707 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4b7ea097-73f4-40e5-bf3e-e23b1343cc40 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:19.552155 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4b7ea097-73f4-40e5-bf3e-e23b1343cc40 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:19.552397 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-3738016f-3c41-4929-bd66-d91a9924f826 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d0cf08accf4a28b85ac2342d9c3023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6a5a6ae8b2488f8a5af6d2066fa88e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:31:19.552919 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4b7ea097-73f4-40e5-bf3e-e23b1343cc40 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:19.553352 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-4b7ea097-73f4-40e5-bf3e-e23b1343cc40 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:19.560813 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-3738016f-3c41-4929-bd66-d91a9924f826 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961" status: 200 len: 1512 microversion: 2.1 time: 0.150521 May 25 16:31:19.562070 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 546/1083] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:31:19 2022] GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:31:19.697183 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-4b7ea097-73f4-40e5-bf3e-e23b1343cc40 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:31:19.704742 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-4b7ea097-73f4-40e5-bf3e-e23b1343cc40 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1554 microversion: 2.1 time: 0.164844 May 25 16:31:19.705304 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 538/1084] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:31:19 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:31:20.579207 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-6edbcd49-0ffa-4158-89ee-7018ab275d17 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:31:20.579843 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-6edbcd49-0ffa-4158-89ee-7018ab275d17 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: 54c81898-0775-4ff6-954e-376c4762b961] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:31:20.585813 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6edbcd49-0ffa-4158-89ee-7018ab275d17 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:20.586267 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6edbcd49-0ffa-4158-89ee-7018ab275d17 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:20.587036 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6edbcd49-0ffa-4158-89ee-7018ab275d17 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:20.587471 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6edbcd49-0ffa-4158-89ee-7018ab275d17 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:20.722025 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-64c5b7e5-e925-4b52-96ab-e50b3f573233 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:31:20.722602 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-64c5b7e5-e925-4b52-96ab-e50b3f573233 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:31:20.728867 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-64c5b7e5-e925-4b52-96ab-e50b3f573233 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:20.729318 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-64c5b7e5-e925-4b52-96ab-e50b3f573233 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:20.730109 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-64c5b7e5-e925-4b52-96ab-e50b3f573233 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:20.730548 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-64c5b7e5-e925-4b52-96ab-e50b3f573233 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:20.908973 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-6edbcd49-0ffa-4158-89ee-7018ab275d17 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d0cf08accf4a28b85ac2342d9c3023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6a5a6ae8b2488f8a5af6d2066fa88e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:31:20.916853 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-6edbcd49-0ffa-4158-89ee-7018ab275d17 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961" status: 200 len: 1512 microversion: 2.1 time: 0.342748 May 25 16:31:20.917430 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 547/1085] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:31:20 2022] GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961 => generated 1512 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:31:21.020758 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [req-f30ada84-60bf-43a5-baf8-ef130215515e req-47a39aab-9e6d-49f6-af6a-4adaf2bf137c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c81898-0775-4ff6-954e-376c4762b961", "name": "network-vif-deleted", "tag": "0f8cdae4-3f59-4856-b865-88fd1b2023dc"}]} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:31:21.032698 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-f30ada84-60bf-43a5-baf8-ef130215515e req-47a39aab-9e6d-49f6-af6a-4adaf2bf137c service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:21.033411 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [req-f30ada84-60bf-43a5-baf8-ef130215515e req-47a39aab-9e6d-49f6-af6a-4adaf2bf137c service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:21.033548 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-64c5b7e5-e925-4b52-96ab-e50b3f573233 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcca87cd01ae464cb1484c3bbd52aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8efc0621a1242329970cda13b3fee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:31:21.044840 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-64c5b7e5-e925-4b52-96ab-e50b3f573233 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 200 len: 1554 microversion: 2.1 time: 0.326742 May 25 16:31:21.052047 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.compute.server_external_events [req-f30ada84-60bf-43a5-baf8-ef130215515e req-47a39aab-9e6d-49f6-af6a-4adaf2bf137c service nova] Creating event network-vif-deleted:0f8cdae4-3f59-4856-b865-88fd1b2023dc for instance 54c81898-0775-4ff6-954e-376c4762b961 on hv-cinder-84327 May 25 16:31:21.062485 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [req-f30ada84-60bf-43a5-baf8-ef130215515e req-47a39aab-9e6d-49f6-af6a-4adaf2bf137c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045294 May 25 16:31:21.065071 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 548/1086] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:31:21.065349 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 539/1087] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:31:20 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 1554 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:31:21.935664 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-2cf377e3-5744-46c4-b770-2eee66c84710 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:31:21.936350 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-2cf377e3-5744-46c4-b770-2eee66c84710 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] [instance: 54c81898-0775-4ff6-954e-376c4762b961] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:31:21.943002 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2cf377e3-5744-46c4-b770-2eee66c84710 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:21.943380 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2cf377e3-5744-46c4-b770-2eee66c84710 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:21.944131 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2cf377e3-5744-46c4-b770-2eee66c84710 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:21.944555 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-2cf377e3-5744-46c4-b770-2eee66c84710 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:21.958257 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.wsgi [None req-2cf377e3-5744-46c4-b770-2eee66c84710 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] HTTP exception thrown: Instance 54c81898-0775-4ff6-954e-376c4762b961 could not be found. May 25 16:31:21.959825 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-2cf377e3-5744-46c4-b770-2eee66c84710 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Request method failure captured: May 25 16:31:21.959825 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: request: GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961 HTTP/1.1 May 25 16:31:21.959825 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept: application/json May 25 16:31:21.959825 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Accept-Encoding: identity May 25 16:31:21.959825 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Connection: close May 25 16:31:21.959825 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Length: 0 May 25 16:31:21.959825 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Content-Type: application/json May 25 16:31:21.959825 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Host: 10.222.0.42 May 25 16:31:21.959825 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Openstack-System-Scope: None May 25 16:31:21.959825 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: User-Agent: python-urllib3/1.26.9 May 25 16:31:21.959825 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Auth-Token: gAAAAABijllrKquf1oPaIm3WPLFXQiRtikerrVtxBOLQpdGRxKlyFQ_tsXNpHyiFoogEEsrfQ3RisS2S5L2PWSDAZ3DyU1KNfMM6SbEDOQjhvfngVreegJq9krQr_Fvo0qRwKx4ki85Y_oSE5iP0Q680xXfGikecWsX0WpaOcMvHJHEM3Eae_j0 May 25 16:31:21.959825 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Id: None May 25 16:31:21.959825 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Domain-Name: None May 25 16:31:21.959825 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Identity-Status: Confirmed May 25 16:31:21.959825 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Is-Admin-Project: True May 25 16:31:21.959825 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Id: default May 25 16:31:21.959825 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Domain-Name: Default May 25 16:31:21.959825 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Id: 9f6a5a6ae8b2488f8a5af6d2066fa88e May 25 16:31:21.959825 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1211637136 May 25 16:31:21.959825 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Role: reader,member May 25 16:31:21.959825 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Roles: reader,member May 25 16:31:21.961474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9f6a5a6ae8b2488f8a5af6d2066fa88e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9f6a5a6ae8b2488f8a5af6d2066fa88e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9f6a5a6ae8b2488f8a5af6d2066fa88e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9f6a5a6ae8b2488f8a5af6d2066fa88e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:31:21.961474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant: tempest-VolumesSnapshotTestJSON-1211637136 May 25 16:31:21.961474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Id: 9f6a5a6ae8b2488f8a5af6d2066fa88e May 25 16:31:21.961474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1211637136 May 25 16:31:21.961474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User: tempest-VolumesSnapshotTestJSON-1211637136-project May 25 16:31:21.961474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Id: default May 25 16:31:21.961474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Domain-Name: Default May 25 16:31:21.961474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Id: 28d0cf08accf4a28b85ac2342d9c3023 May 25 16:31:21.961474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: X-User-Name: tempest-VolumesSnapshotTestJSON-1211637136-project May 25 16:31:21.961474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: method: > May 25 16:31:21.961474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: exception: Instance 54c81898-0775-4ff6-954e-376c4762b961 could not be found. May 25 16:31:21.961474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: action_args: {'id': '54c81898-0775-4ff6-954e-376c4762b961'} May 25 16:31:21.962474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:31:21.962474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:31:21.962474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:31:21.962474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:31:21.962474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:31:21.962474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:31:21.962474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:31:21.962474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:31:21.962474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:31:21.962474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:31:21.962474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54c81898-0775-4ff6-954e-376c4762b961 could not be found. May 25 16:31:21.962474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:31:21.962474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:31:21.962474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:31:21.962474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:31:21.962474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:31:21.962474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:31:21.962474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:31:21.962474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:31:21.962474 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:31:21.964099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:31:21.964099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:31:21.964099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:31:21.964099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:31:21.964099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:31:21.964099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:31:21.964099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:31:21.964099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54c81898-0775-4ff6-954e-376c4762b961 could not be found. May 25 16:31:21.964099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:31:21.964099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:31:21.964099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:31:21.964099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:31:21.964099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:31:21.964099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:31:21.964099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:31:21.964099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:31:21.964099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54c81898-0775-4ff6-954e-376c4762b961 could not be found. May 25 16:31:21.964099 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: ERROR nova.api.openstack.wsgi May 25 16:31:21.966247 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-2cf377e3-5744-46c4-b770-2eee66c84710 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] Returning 404 to user: Instance 54c81898-0775-4ff6-954e-376c4762b961 could not be found. {{(pid=117509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:31:21.966247 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-2cf377e3-5744-46c4-b770-2eee66c84710 tempest-VolumesSnapshotTestJSON-1211637136 tempest-VolumesSnapshotTestJSON-1211637136-project] 10.222.0.42 "GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961" status: 404 len: 111 microversion: 2.1 time: 0.030398 May 25 16:31:21.966247 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 549/1088] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:31:21 2022] GET /compute/v2.1/servers/54c81898-0775-4ff6-954e-376c4762b961 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:31:22.062335 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-dd62ecbd-c3f0-4e98-ab44-11e2595e240c tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:31:22.062953 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-dd62ecbd-c3f0-4e98-ab44-11e2595e240c tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] [instance: 11516011-7294-415c-9637-27fe37077315] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:31:22.069346 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dd62ecbd-c3f0-4e98-ab44-11e2595e240c tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:22.070052 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dd62ecbd-c3f0-4e98-ab44-11e2595e240c tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:22.070825 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dd62ecbd-c3f0-4e98-ab44-11e2595e240c tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:22.071269 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-dd62ecbd-c3f0-4e98-ab44-11e2595e240c tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:22.085291 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.wsgi [None req-dd62ecbd-c3f0-4e98-ab44-11e2595e240c tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] HTTP exception thrown: Instance 11516011-7294-415c-9637-27fe37077315 could not be found. May 25 16:31:22.086973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-dd62ecbd-c3f0-4e98-ab44-11e2595e240c tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Request method failure captured: May 25 16:31:22.086973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: request: GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 HTTP/1.1 May 25 16:31:22.086973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept: application/json May 25 16:31:22.086973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept-Encoding: identity May 25 16:31:22.086973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Connection: close May 25 16:31:22.086973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Length: 0 May 25 16:31:22.086973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Type: application/json May 25 16:31:22.086973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Host: 10.222.0.42 May 25 16:31:22.086973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Openstack-System-Scope: None May 25 16:31:22.086973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: User-Agent: python-urllib3/1.26.9 May 25 16:31:22.086973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Auth-Token: gAAAAABijllBQRBwHb-Dhf36wa0E7fEJJAoN5NhqcYkzaqtTeRXdDDk6ievZduFyhQZuQM0dUmRLBToo9Wugv_meHoSYXoEfrNN8PznVMw50YuxrXVDrYNSIumn5O8rYB1Mi___03v59awuYHFAH4mGkLemBIMPAxXazZgOvvfpVJmuHWG3CaYQ May 25 16:31:22.086973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Id: None May 25 16:31:22.086973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Name: None May 25 16:31:22.086973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Identity-Status: Confirmed May 25 16:31:22.086973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Is-Admin-Project: True May 25 16:31:22.086973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Id: default May 25 16:31:22.086973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Name: Default May 25 16:31:22.086973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Id: c8efc0621a1242329970cda13b3fee4b May 25 16:31:22.086973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Name: tempest-TestMinimumBasicScenario-908225847 May 25 16:31:22.086973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Role: reader,member May 25 16:31:22.086973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Roles: reader,member May 25 16:31:22.089126 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c8efc0621a1242329970cda13b3fee4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c8efc0621a1242329970cda13b3fee4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c8efc0621a1242329970cda13b3fee4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c8efc0621a1242329970cda13b3fee4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:31:22.089126 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant: tempest-TestMinimumBasicScenario-908225847 May 25 16:31:22.089126 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Id: c8efc0621a1242329970cda13b3fee4b May 25 16:31:22.089126 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Name: tempest-TestMinimumBasicScenario-908225847 May 25 16:31:22.089126 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User: tempest-TestMinimumBasicScenario-908225847-project May 25 16:31:22.089126 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Id: default May 25 16:31:22.089126 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Name: Default May 25 16:31:22.089126 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Id: fcca87cd01ae464cb1484c3bbd52aaf6 May 25 16:31:22.089126 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Name: tempest-TestMinimumBasicScenario-908225847-project May 25 16:31:22.089126 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: method: > May 25 16:31:22.089126 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: exception: Instance 11516011-7294-415c-9637-27fe37077315 could not be found. May 25 16:31:22.089126 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: action_args: {'id': '11516011-7294-415c-9637-27fe37077315'} May 25 16:31:22.090870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:31:22.090870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:31:22.090870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:31:22.090870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:31:22.090870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:31:22.090870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:31:22.090870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:31:22.090870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:31:22.090870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:31:22.090870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:31:22.090870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11516011-7294-415c-9637-27fe37077315 could not be found. May 25 16:31:22.090870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:31:22.090870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:31:22.090870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:31:22.090870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:31:22.090870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:31:22.090870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:31:22.090870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:31:22.090870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:31:22.090870 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:31:22.092656 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:31:22.092656 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:31:22.092656 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:31:22.092656 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:31:22.092656 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:31:22.092656 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:31:22.092656 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:31:22.092656 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11516011-7294-415c-9637-27fe37077315 could not be found. May 25 16:31:22.092656 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:31:22.092656 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:31:22.092656 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:31:22.092656 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:31:22.092656 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:31:22.092656 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:31:22.092656 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:31:22.092656 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:31:22.092656 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11516011-7294-415c-9637-27fe37077315 could not be found. May 25 16:31:22.092656 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:31:22.093926 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-dd62ecbd-c3f0-4e98-ab44-11e2595e240c tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Returning 404 to user: Instance 11516011-7294-415c-9637-27fe37077315 could not be found. {{(pid=117510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:31:22.093926 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-dd62ecbd-c3f0-4e98-ab44-11e2595e240c tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315" status: 404 len: 111 microversion: 2.1 time: 0.030054 May 25 16:31:22.093926 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 540/1089] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:31:22 2022] GET /compute/v2.1/servers/11516011-7294-415c-9637-27fe37077315 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:31:22.099062 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-415aca55-2ac3-4fd2-b9c6-0ada4ab1d5e1 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] Calling method '.version_select at 0x7f51f0530ca0>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:31:22.121207 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-415aca55-2ac3-4fd2-b9c6-0ada4ab1d5e1 tempest-TestMinimumBasicScenario-908225847 tempest-TestMinimumBasicScenario-908225847-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-234239692" status: 202 len: 0 microversion: 2.1 time: 0.025912 May 25 16:31:22.122057 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 550/1090] 10.222.0.42 () {58 vars in 1268 bytes} [Wed May 25 16:31:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-234239692 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:31:23.082072 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-e868d11d-299a-4b55-bec5-3976388e6bf6 req-5c048320-33d4-4e1d-84ee-6c8072b13971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11516011-7294-415c-9637-27fe37077315", "name": "network-vif-deleted", "tag": "0bc5d294-6526-41f2-a874-eb5b98d8279f"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:31:23.090526 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-e868d11d-299a-4b55-bec5-3976388e6bf6 req-5c048320-33d4-4e1d-84ee-6c8072b13971 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:31:23.090973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-e868d11d-299a-4b55-bec5-3976388e6bf6 req-5c048320-33d4-4e1d-84ee-6c8072b13971 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:31:23.102040 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-e868d11d-299a-4b55-bec5-3976388e6bf6 req-5c048320-33d4-4e1d-84ee-6c8072b13971 service nova] Creating event network-vif-deleted:0bc5d294-6526-41f2-a874-eb5b98d8279f for instance 11516011-7294-415c-9637-27fe37077315 on hv-cinder-84327 May 25 16:31:23.107808 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-e868d11d-299a-4b55-bec5-3976388e6bf6 req-5c048320-33d4-4e1d-84ee-6c8072b13971 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029451 May 25 16:31:23.108398 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 541/1091] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:32:48.895035 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:32:48.895778 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:32:48.900264 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-cd127747-d1c5-4087-910a-9b62fe8b6147 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:32:48.900926 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-cd127747-d1c5-4087-910a-9b62fe8b6147 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:32:48.909015 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-cd127747-d1c5-4087-910a-9b62fe8b6147 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:32:48.909464 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-cd127747-d1c5-4087-910a-9b62fe8b6147 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:32:48.910251 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-cd127747-d1c5-4087-910a-9b62fe8b6147 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:32:48.910690 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-cd127747-d1c5-4087-910a-9b62fe8b6147 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:32:48.935256 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.objects.instance [None req-cd127747-d1c5-4087-910a-9b62fe8b6147 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lazy-loading 'flavor' on Instance uuid 67d74924-5509-4362-b314-27e375267a10 {{(pid=117509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:32:49.005818 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-cd127747-d1c5-4087-910a-9b62fe8b6147 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "POST /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10/action" status: 202 len: 0 microversion: 2.1 time: 0.112533 May 25 16:32:49.006397 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 551/1092] 10.222.0.42 () {60 vars in 1277 bytes} [Wed May 25 16:32:48 2022] POST /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:32:49.013319 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:32:49.014105 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:32:49.018295 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-3359c2c0-4836-409d-934c-a6ab66d63716 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:32:49.018993 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-3359c2c0-4836-409d-934c-a6ab66d63716 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:32:49.027111 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3359c2c0-4836-409d-934c-a6ab66d63716 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:32:49.027554 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3359c2c0-4836-409d-934c-a6ab66d63716 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:32:49.028315 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3359c2c0-4836-409d-934c-a6ab66d63716 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:32:49.028747 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-3359c2c0-4836-409d-934c-a6ab66d63716 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:32:49.161497 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-3359c2c0-4836-409d-934c-a6ab66d63716 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:32:49.169894 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-3359c2c0-4836-409d-934c-a6ab66d63716 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1569 microversion: 2.1 time: 0.158730 May 25 16:32:49.170454 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 542/1093] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:32:49 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:32:50.188890 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-50076bb1-b199-4535-a57c-0c795e8a8be2 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:32:50.189633 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-50076bb1-b199-4535-a57c-0c795e8a8be2 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:32:50.195946 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-50076bb1-b199-4535-a57c-0c795e8a8be2 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:32:50.196390 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-50076bb1-b199-4535-a57c-0c795e8a8be2 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:32:50.197155 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-50076bb1-b199-4535-a57c-0c795e8a8be2 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:32:50.197590 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-50076bb1-b199-4535-a57c-0c795e8a8be2 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:32:50.330596 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-50076bb1-b199-4535-a57c-0c795e8a8be2 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:32:50.338124 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-50076bb1-b199-4535-a57c-0c795e8a8be2 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1569 microversion: 2.1 time: 0.154301 May 25 16:32:50.338830 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 552/1094] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:32:50 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:32:51.355754 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-8bd5ddbf-8d14-4340-9433-45e2e8090c1d tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:32:51.356362 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-8bd5ddbf-8d14-4340-9433-45e2e8090c1d tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:32:51.363015 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8bd5ddbf-8d14-4340-9433-45e2e8090c1d tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:32:51.363467 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8bd5ddbf-8d14-4340-9433-45e2e8090c1d tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:32:51.364229 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8bd5ddbf-8d14-4340-9433-45e2e8090c1d tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:32:51.364669 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-8bd5ddbf-8d14-4340-9433-45e2e8090c1d tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:32:51.503379 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-8bd5ddbf-8d14-4340-9433-45e2e8090c1d tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:32:51.511261 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-8bd5ddbf-8d14-4340-9433-45e2e8090c1d tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1569 microversion: 2.1 time: 0.159943 May 25 16:32:51.511822 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 543/1095] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:32:51 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:32:52.581873 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-a60e0635-f508-4d91-87cb-913899cbafa2 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:32:52.582479 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-a60e0635-f508-4d91-87cb-913899cbafa2 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:32:52.589142 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a60e0635-f508-4d91-87cb-913899cbafa2 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:32:52.589632 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a60e0635-f508-4d91-87cb-913899cbafa2 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:32:52.590390 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a60e0635-f508-4d91-87cb-913899cbafa2 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:32:52.590826 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a60e0635-f508-4d91-87cb-913899cbafa2 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:32:52.718031 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-a60e0635-f508-4d91-87cb-913899cbafa2 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:32:52.725460 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-a60e0635-f508-4d91-87cb-913899cbafa2 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1569 microversion: 2.1 time: 0.147500 May 25 16:32:52.726057 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 553/1096] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:32:52 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:32:53.743354 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-fee27e59-f038-4e26-98e5-db34174d5d7e tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:32:53.743887 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-fee27e59-f038-4e26-98e5-db34174d5d7e tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:32:53.750964 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-fee27e59-f038-4e26-98e5-db34174d5d7e tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:32:53.751411 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-fee27e59-f038-4e26-98e5-db34174d5d7e tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:32:53.752164 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-fee27e59-f038-4e26-98e5-db34174d5d7e tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:32:53.752597 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-fee27e59-f038-4e26-98e5-db34174d5d7e tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:32:53.884358 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-fee27e59-f038-4e26-98e5-db34174d5d7e tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:32:53.892769 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-fee27e59-f038-4e26-98e5-db34174d5d7e tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1569 microversion: 2.1 time: 0.153357 May 25 16:32:53.893300 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 544/1097] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:32:53 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:32:54.910016 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-6d921616-c0b6-48c1-be85-09be638f5524 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:32:54.910628 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-6d921616-c0b6-48c1-be85-09be638f5524 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:32:54.917527 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6d921616-c0b6-48c1-be85-09be638f5524 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:32:54.917999 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6d921616-c0b6-48c1-be85-09be638f5524 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:32:54.918754 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6d921616-c0b6-48c1-be85-09be638f5524 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:32:54.919187 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-6d921616-c0b6-48c1-be85-09be638f5524 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:32:55.046507 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-6d921616-c0b6-48c1-be85-09be638f5524 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:32:55.053910 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-6d921616-c0b6-48c1-be85-09be638f5524 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1569 microversion: 2.1 time: 0.147804 May 25 16:32:55.054648 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 554/1098] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:32:54 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:32:56.071519 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-f8b77acc-3013-4ce3-b25d-9e1986d5ace7 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:32:56.072131 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-f8b77acc-3013-4ce3-b25d-9e1986d5ace7 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:32:56.078915 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f8b77acc-3013-4ce3-b25d-9e1986d5ace7 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:32:56.079371 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f8b77acc-3013-4ce3-b25d-9e1986d5ace7 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:32:56.080137 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f8b77acc-3013-4ce3-b25d-9e1986d5ace7 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:32:56.080581 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f8b77acc-3013-4ce3-b25d-9e1986d5ace7 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:32:56.211260 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-f8b77acc-3013-4ce3-b25d-9e1986d5ace7 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:32:56.222620 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-f8b77acc-3013-4ce3-b25d-9e1986d5ace7 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1569 microversion: 2.1 time: 0.155016 May 25 16:32:56.223183 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 545/1099] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:32:56 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:32:57.240110 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-f3885698-c8c8-4aa1-9f29-66e27f73af7c tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:32:57.240715 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-f3885698-c8c8-4aa1-9f29-66e27f73af7c tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:32:57.247179 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f3885698-c8c8-4aa1-9f29-66e27f73af7c tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:32:57.247616 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f3885698-c8c8-4aa1-9f29-66e27f73af7c tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:32:57.248361 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f3885698-c8c8-4aa1-9f29-66e27f73af7c tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:32:57.248786 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-f3885698-c8c8-4aa1-9f29-66e27f73af7c tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:32:57.383880 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-f3885698-c8c8-4aa1-9f29-66e27f73af7c tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:32:57.391792 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-f3885698-c8c8-4aa1-9f29-66e27f73af7c tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1569 microversion: 2.1 time: 0.155730 May 25 16:32:57.392345 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 555/1100] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:32:57 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:32:58.410199 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-220b2458-14b7-46b5-b4eb-9e22777f17bf tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:32:58.410806 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-220b2458-14b7-46b5-b4eb-9e22777f17bf tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:32:58.417925 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-220b2458-14b7-46b5-b4eb-9e22777f17bf tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:32:58.418376 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-220b2458-14b7-46b5-b4eb-9e22777f17bf tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:32:58.419140 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-220b2458-14b7-46b5-b4eb-9e22777f17bf tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:32:58.419570 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-220b2458-14b7-46b5-b4eb-9e22777f17bf tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:32:58.548853 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-220b2458-14b7-46b5-b4eb-9e22777f17bf tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:32:58.556400 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-220b2458-14b7-46b5-b4eb-9e22777f17bf tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1569 microversion: 2.1 time: 0.150812 May 25 16:32:58.557067 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 546/1101] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:32:58 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:32:59.573692 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-abc9d666-706b-44e3-8d2c-0f1c79fd2ebb tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:32:59.574443 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-abc9d666-706b-44e3-8d2c-0f1c79fd2ebb tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:32:59.581242 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-abc9d666-706b-44e3-8d2c-0f1c79fd2ebb tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:32:59.581688 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-abc9d666-706b-44e3-8d2c-0f1c79fd2ebb tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:32:59.582493 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-abc9d666-706b-44e3-8d2c-0f1c79fd2ebb tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:32:59.582938 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-abc9d666-706b-44e3-8d2c-0f1c79fd2ebb tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:32:59.788232 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-abc9d666-706b-44e3-8d2c-0f1c79fd2ebb tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:32:59.796567 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-abc9d666-706b-44e3-8d2c-0f1c79fd2ebb tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1569 microversion: 2.1 time: 0.226835 May 25 16:32:59.797135 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 556/1102] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:32:59 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1569 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:33:00.814175 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-95c217b2-39d8-4e95-80a5-f32ed2c5f4f0 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:33:00.814837 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-95c217b2-39d8-4e95-80a5-f32ed2c5f4f0 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:33:00.821269 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-95c217b2-39d8-4e95-80a5-f32ed2c5f4f0 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:33:00.821730 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-95c217b2-39d8-4e95-80a5-f32ed2c5f4f0 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:33:00.822613 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-95c217b2-39d8-4e95-80a5-f32ed2c5f4f0 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:33:00.823394 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-95c217b2-39d8-4e95-80a5-f32ed2c5f4f0 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:33:00.950254 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-95c217b2-39d8-4e95-80a5-f32ed2c5f4f0 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:33:00.957675 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-95c217b2-39d8-4e95-80a5-f32ed2c5f4f0 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1569 microversion: 2.1 time: 0.147341 May 25 16:33:00.958283 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 547/1103] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:33:00 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:33:01.974744 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-40526975-d3c5-46a2-960c-69a92c0c55de tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:33:01.975347 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-40526975-d3c5-46a2-960c-69a92c0c55de tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:33:01.981876 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-40526975-d3c5-46a2-960c-69a92c0c55de tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:33:01.982317 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-40526975-d3c5-46a2-960c-69a92c0c55de tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:33:01.983073 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-40526975-d3c5-46a2-960c-69a92c0c55de tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:33:01.983505 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-40526975-d3c5-46a2-960c-69a92c0c55de tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:33:02.113942 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-40526975-d3c5-46a2-960c-69a92c0c55de tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:33:02.122629 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-40526975-d3c5-46a2-960c-69a92c0c55de tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1510 microversion: 2.1 time: 0.151761 May 25 16:33:02.123198 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 557/1104] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:33:01 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:33:02.139400 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-08b17cb0-2a6a-4688-a344-6433f04a4321 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:33:02.139973 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-08b17cb0-2a6a-4688-a344-6433f04a4321 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:33:02.146388 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-08b17cb0-2a6a-4688-a344-6433f04a4321 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:33:02.146838 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-08b17cb0-2a6a-4688-a344-6433f04a4321 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:33:02.147600 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-08b17cb0-2a6a-4688-a344-6433f04a4321 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:33:02.148038 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-08b17cb0-2a6a-4688-a344-6433f04a4321 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:33:02.221907 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-08b17cb0-2a6a-4688-a344-6433f04a4321 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "POST /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10/action" status: 202 len: 0 microversion: 2.1 time: 0.086780 May 25 16:33:02.222415 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 548/1105] 10.222.0.42 () {60 vars in 1277 bytes} [Wed May 25 16:33:02 2022] POST /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 16:33:02.230778 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-a5586b0b-67a2-45d5-86d4-df1c304f2149 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:33:02.231286 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-a5586b0b-67a2-45d5-86d4-df1c304f2149 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:33:02.237087 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a5586b0b-67a2-45d5-86d4-df1c304f2149 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:33:02.237523 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a5586b0b-67a2-45d5-86d4-df1c304f2149 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:33:02.238302 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a5586b0b-67a2-45d5-86d4-df1c304f2149 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:33:02.238727 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-a5586b0b-67a2-45d5-86d4-df1c304f2149 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:33:02.372941 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-a5586b0b-67a2-45d5-86d4-df1c304f2149 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:33:02.380317 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-a5586b0b-67a2-45d5-86d4-df1c304f2149 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1518 microversion: 2.1 time: 0.153763 May 25 16:33:02.380887 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 558/1106] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:33:02 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:33:03.397509 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-7954df5c-ded6-448a-a2bd-d33e47807bf4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:33:03.398087 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-7954df5c-ded6-448a-a2bd-d33e47807bf4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:33:03.406116 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7954df5c-ded6-448a-a2bd-d33e47807bf4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:33:03.406560 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7954df5c-ded6-448a-a2bd-d33e47807bf4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:33:03.407370 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7954df5c-ded6-448a-a2bd-d33e47807bf4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:33:03.407801 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-7954df5c-ded6-448a-a2bd-d33e47807bf4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:33:03.545254 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-7954df5c-ded6-448a-a2bd-d33e47807bf4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:33:03.553023 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-7954df5c-ded6-448a-a2bd-d33e47807bf4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1520 microversion: 2.1 time: 0.159505 May 25 16:33:03.553825 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 549/1107] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:33:03 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:33:04.571867 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-967382a0-bff4-48de-b185-d23b74466664 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:33:04.572534 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-967382a0-bff4-48de-b185-d23b74466664 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:33:04.579017 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-967382a0-bff4-48de-b185-d23b74466664 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:33:04.579465 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-967382a0-bff4-48de-b185-d23b74466664 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:33:04.580224 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-967382a0-bff4-48de-b185-d23b74466664 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:33:04.580660 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-967382a0-bff4-48de-b185-d23b74466664 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:33:04.709831 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-967382a0-bff4-48de-b185-d23b74466664 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:33:04.717438 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-967382a0-bff4-48de-b185-d23b74466664 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1576 microversion: 2.1 time: 0.149514 May 25 16:33:04.718037 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 559/1108] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:33:04 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:33:05.080540 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-6fd0d61f-28bf-477d-983f-7f9f6c496b1d req-59123699-aa6a-4fdd-b2cd-dd9e1e959b6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67d74924-5509-4362-b314-27e375267a10", "name": "network-vif-unplugged", "status": "completed", "tag": "0a1fd3e6-89fa-451b-a2f8-e586a9d6a09a"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:33:05.089235 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-6fd0d61f-28bf-477d-983f-7f9f6c496b1d req-59123699-aa6a-4fdd-b2cd-dd9e1e959b6f service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:33:05.089829 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-6fd0d61f-28bf-477d-983f-7f9f6c496b1d req-59123699-aa6a-4fdd-b2cd-dd9e1e959b6f service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:33:05.103071 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-6fd0d61f-28bf-477d-983f-7f9f6c496b1d req-59123699-aa6a-4fdd-b2cd-dd9e1e959b6f service nova] Creating event network-vif-unplugged:0a1fd3e6-89fa-451b-a2f8-e586a9d6a09a for instance 67d74924-5509-4362-b314-27e375267a10 on hv-cinder-84327 May 25 16:33:05.108070 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-6fd0d61f-28bf-477d-983f-7f9f6c496b1d req-59123699-aa6a-4fdd-b2cd-dd9e1e959b6f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093133 May 25 16:33:05.108653 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 550/1109] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:33:05.735324 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-5467c3c5-2039-4af3-a6fb-537022e53d73 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:33:05.735871 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-5467c3c5-2039-4af3-a6fb-537022e53d73 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:33:05.742331 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5467c3c5-2039-4af3-a6fb-537022e53d73 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:33:05.742781 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5467c3c5-2039-4af3-a6fb-537022e53d73 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:33:05.743542 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5467c3c5-2039-4af3-a6fb-537022e53d73 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:33:05.743979 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-5467c3c5-2039-4af3-a6fb-537022e53d73 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:33:05.873479 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-5467c3c5-2039-4af3-a6fb-537022e53d73 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:33:05.880974 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-5467c3c5-2039-4af3-a6fb-537022e53d73 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1576 microversion: 2.1 time: 0.149608 May 25 16:33:05.881545 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 560/1110] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:33:05 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:33:06.899085 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-94cdab05-31ff-411f-8f04-11191a9bffd4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:33:06.899782 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-94cdab05-31ff-411f-8f04-11191a9bffd4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:33:06.906546 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-94cdab05-31ff-411f-8f04-11191a9bffd4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:33:06.907000 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-94cdab05-31ff-411f-8f04-11191a9bffd4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:33:06.907778 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-94cdab05-31ff-411f-8f04-11191a9bffd4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:33:06.908199 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-94cdab05-31ff-411f-8f04-11191a9bffd4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:33:07.040872 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-94cdab05-31ff-411f-8f04-11191a9bffd4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:33:07.048865 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-94cdab05-31ff-411f-8f04-11191a9bffd4 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1576 microversion: 2.1 time: 0.154488 May 25 16:33:07.049362 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 551/1111] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:33:06 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:33:08.065860 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-7f8aec6e-db7e-45cc-be7d-2a0d4ec79960 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:33:08.066524 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-7f8aec6e-db7e-45cc-be7d-2a0d4ec79960 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:33:08.073284 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7f8aec6e-db7e-45cc-be7d-2a0d4ec79960 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:33:08.073754 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7f8aec6e-db7e-45cc-be7d-2a0d4ec79960 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:33:08.074521 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7f8aec6e-db7e-45cc-be7d-2a0d4ec79960 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:33:08.074960 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-7f8aec6e-db7e-45cc-be7d-2a0d4ec79960 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:33:08.207642 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-7f8aec6e-db7e-45cc-be7d-2a0d4ec79960 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:33:08.215730 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-7f8aec6e-db7e-45cc-be7d-2a0d4ec79960 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1576 microversion: 2.1 time: 0.153843 May 25 16:33:08.216297 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 561/1112] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:33:08 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:33:09.232934 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-b94f68b8-3d5e-4436-bb19-72204fd8cb70 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:33:09.233532 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-b94f68b8-3d5e-4436-bb19-72204fd8cb70 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:33:09.239652 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b94f68b8-3d5e-4436-bb19-72204fd8cb70 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:33:09.240094 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b94f68b8-3d5e-4436-bb19-72204fd8cb70 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:33:09.240843 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b94f68b8-3d5e-4436-bb19-72204fd8cb70 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:33:09.241274 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-b94f68b8-3d5e-4436-bb19-72204fd8cb70 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:33:09.370516 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-b94f68b8-3d5e-4436-bb19-72204fd8cb70 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:33:09.377865 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-b94f68b8-3d5e-4436-bb19-72204fd8cb70 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1576 microversion: 2.1 time: 0.149164 May 25 16:33:09.378414 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 552/1113] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:33:09 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:33:10.395891 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-73773c84-1684-4697-97b3-ef6b1cb0475b tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:33:10.396509 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-73773c84-1684-4697-97b3-ef6b1cb0475b tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:33:10.403504 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-73773c84-1684-4697-97b3-ef6b1cb0475b tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:33:10.403958 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-73773c84-1684-4697-97b3-ef6b1cb0475b tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:33:10.404764 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-73773c84-1684-4697-97b3-ef6b1cb0475b tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:33:10.405203 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-73773c84-1684-4697-97b3-ef6b1cb0475b tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:33:10.601982 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-73773c84-1684-4697-97b3-ef6b1cb0475b tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:33:10.609806 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-73773c84-1684-4697-97b3-ef6b1cb0475b tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1576 microversion: 2.1 time: 0.217946 May 25 16:33:10.610376 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 562/1114] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:33:10 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1576 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:33:11.627920 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-cbdb567c-0774-41c0-87a0-5ea8f8cc231f tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:33:11.628525 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-cbdb567c-0774-41c0-87a0-5ea8f8cc231f tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:33:11.634432 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-cbdb567c-0774-41c0-87a0-5ea8f8cc231f tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:33:11.634947 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-cbdb567c-0774-41c0-87a0-5ea8f8cc231f tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:33:11.635956 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-cbdb567c-0774-41c0-87a0-5ea8f8cc231f tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:33:11.636388 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-cbdb567c-0774-41c0-87a0-5ea8f8cc231f tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:33:11.766313 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-cbdb567c-0774-41c0-87a0-5ea8f8cc231f tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:33:11.775864 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-cbdb567c-0774-41c0-87a0-5ea8f8cc231f tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1576 microversion: 2.1 time: 0.151936 May 25 16:33:11.776432 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 553/1115] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:33:11 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:33:12.793487 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-1bf0bc75-f038-4499-a703-297272d4fdd3 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:33:12.794117 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-1bf0bc75-f038-4499-a703-297272d4fdd3 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:33:12.800551 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1bf0bc75-f038-4499-a703-297272d4fdd3 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:33:12.800988 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1bf0bc75-f038-4499-a703-297272d4fdd3 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:33:12.801785 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1bf0bc75-f038-4499-a703-297272d4fdd3 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:33:12.802228 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1bf0bc75-f038-4499-a703-297272d4fdd3 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:33:12.936553 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-1bf0bc75-f038-4499-a703-297272d4fdd3 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:33:12.944258 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-1bf0bc75-f038-4499-a703-297272d4fdd3 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1563 microversion: 2.1 time: 0.155771 May 25 16:33:12.944818 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 563/1116] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:33:12 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:33:15.110083 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-b1ae22af-df35-4c92-90a4-33f30d05c8f0 req-89522b1b-885d-4aa5-a0c8-2ea08ec05b41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67d74924-5509-4362-b314-27e375267a10", "name": "network-vif-plugged", "status": "completed", "tag": "0a1fd3e6-89fa-451b-a2f8-e586a9d6a09a"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:33:15.118687 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-b1ae22af-df35-4c92-90a4-33f30d05c8f0 req-89522b1b-885d-4aa5-a0c8-2ea08ec05b41 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:33:15.119803 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-b1ae22af-df35-4c92-90a4-33f30d05c8f0 req-89522b1b-885d-4aa5-a0c8-2ea08ec05b41 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:33:15.130887 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-b1ae22af-df35-4c92-90a4-33f30d05c8f0 req-89522b1b-885d-4aa5-a0c8-2ea08ec05b41 service nova] Creating event network-vif-plugged:0a1fd3e6-89fa-451b-a2f8-e586a9d6a09a for instance 67d74924-5509-4362-b314-27e375267a10 on hv-cinder-84327 May 25 16:33:15.136133 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-b1ae22af-df35-4c92-90a4-33f30d05c8f0 req-89522b1b-885d-4aa5-a0c8-2ea08ec05b41 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029734 May 25 16:33:15.136719 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 554/1117] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:33:46.697481 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 16:33:46.698069 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Wed May 25 16:33:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 16:33:49.744339 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 16:33:49.744886 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Wed May 25 16:33:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 16:33:59.913924 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 16:33:59.914565 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Wed May 25 16:33:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 16:34:23.590912 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_api:SELECT=26 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:34:23.592237 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG dbcounter [-] [117509] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:34:23.592433 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_api:SELECT=28 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:34:23.593169 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG dbcounter [-] [117510] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:34:23.597166 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-03cd2e49-5991-413a-bd89-5e5f5b3f6d0c tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:34:23.597409 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-406ac495-8983-4cdc-bac1-e0f81d73b291 req-8dff3b08-b3ee-446d-895c-a4704d374115 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67d74924-5509-4362-b314-27e375267a10", "tag": "0a1fd3e6-89fa-451b-a2f8-e586a9d6a09a"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:34:23.597869 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-03cd2e49-5991-413a-bd89-5e5f5b3f6d0c tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:34:23.607282 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-03cd2e49-5991-413a-bd89-5e5f5b3f6d0c tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:34:23.607914 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-03cd2e49-5991-413a-bd89-5e5f5b3f6d0c tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:34:23.608044 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-406ac495-8983-4cdc-bac1-e0f81d73b291 req-8dff3b08-b3ee-446d-895c-a4704d374115 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:34:23.608471 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-406ac495-8983-4cdc-bac1-e0f81d73b291 req-8dff3b08-b3ee-446d-895c-a4704d374115 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:34:23.608669 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-03cd2e49-5991-413a-bd89-5e5f5b3f6d0c tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:34:23.609346 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-03cd2e49-5991-413a-bd89-5e5f5b3f6d0c tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:34:23.620102 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-406ac495-8983-4cdc-bac1-e0f81d73b291 req-8dff3b08-b3ee-446d-895c-a4704d374115 service nova] Creating event network-changed:0a1fd3e6-89fa-451b-a2f8-e586a9d6a09a for instance 67d74924-5509-4362-b314-27e375267a10 on hv-cinder-84327 May 25 16:34:23.625369 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-406ac495-8983-4cdc-bac1-e0f81d73b291 req-8dff3b08-b3ee-446d-895c-a4704d374115 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034731 May 25 16:34:23.626345 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 555/1118] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:34:23.640034 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-03cd2e49-5991-413a-bd89-5e5f5b3f6d0c tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Going to try to terminate instance {{(pid=117509) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:34:23.731405 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-03cd2e49-5991-413a-bd89-5e5f5b3f6d0c tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "DELETE /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 204 len: 0 microversion: 2.1 time: 0.141869 May 25 16:34:23.732249 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 564/1119] 10.222.0.42 () {58 vars in 1238 bytes} [Wed May 25 16:34:23 2022] DELETE /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:34:23.740938 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-0163cf1f-3e22-4d89-aacf-25fd4a1bd348 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:34:23.742039 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-0163cf1f-3e22-4d89-aacf-25fd4a1bd348 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:34:23.750280 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0163cf1f-3e22-4d89-aacf-25fd4a1bd348 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:34:23.750842 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0163cf1f-3e22-4d89-aacf-25fd4a1bd348 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:34:23.751898 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0163cf1f-3e22-4d89-aacf-25fd4a1bd348 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:34:23.752519 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-0163cf1f-3e22-4d89-aacf-25fd4a1bd348 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:34:23.898136 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.policy [None req-0163cf1f-3e22-4d89-aacf-25fd4a1bd348 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117510) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:34:23.906322 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-0163cf1f-3e22-4d89-aacf-25fd4a1bd348 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1569 microversion: 2.1 time: 0.169536 May 25 16:34:23.906889 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 556/1120] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:34:23 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:34:24.924908 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-1f68f161-958c-427c-9c26-13ba4bc6ddff tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:34:24.925598 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-1f68f161-958c-427c-9c26-13ba4bc6ddff tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:34:24.932627 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1f68f161-958c-427c-9c26-13ba4bc6ddff tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:34:24.933073 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1f68f161-958c-427c-9c26-13ba4bc6ddff tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:34:24.933872 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1f68f161-958c-427c-9c26-13ba4bc6ddff tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:34:24.934302 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-1f68f161-958c-427c-9c26-13ba4bc6ddff tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:34:25.107527 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-1f68f161-958c-427c-9c26-13ba4bc6ddff tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:34:25.115026 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-1f68f161-958c-427c-9c26-13ba4bc6ddff tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1569 microversion: 2.1 time: 0.194437 May 25 16:34:25.115589 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 565/1121] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:34:24 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1569 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:34:25.693647 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [req-f811681f-0165-45f1-974e-907390fbe13a req-311f73df-8999-4f79-b9bc-57d2f6b18209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67d74924-5509-4362-b314-27e375267a10", "name": "network-vif-deleted", "tag": "0a1fd3e6-89fa-451b-a2f8-e586a9d6a09a"}]} {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:34:25.705889 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-f811681f-0165-45f1-974e-907390fbe13a req-311f73df-8999-4f79-b9bc-57d2f6b18209 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:34:25.706330 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [req-f811681f-0165-45f1-974e-907390fbe13a req-311f73df-8999-4f79-b9bc-57d2f6b18209 service nova] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:34:25.718321 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.compute.server_external_events [req-f811681f-0165-45f1-974e-907390fbe13a req-311f73df-8999-4f79-b9bc-57d2f6b18209 service nova] Creating event network-vif-deleted:0a1fd3e6-89fa-451b-a2f8-e586a9d6a09a for instance 67d74924-5509-4362-b314-27e375267a10 on hv-cinder-84327 May 25 16:34:25.724685 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [req-f811681f-0165-45f1-974e-907390fbe13a req-311f73df-8999-4f79-b9bc-57d2f6b18209 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034766 May 25 16:34:25.725260 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 557/1122] 10.222.0.42 () {64 vars in 1317 bytes} [Wed May 25 16:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:34:26.133068 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-21fa2e04-d778-45c7-83aa-e829a23f19b3 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:34:26.134545 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.compute.api [None req-21fa2e04-d778-45c7-83aa-e829a23f19b3 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117509) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:34:26.140713 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-21fa2e04-d778-45c7-83aa-e829a23f19b3 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:34:26.141156 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-21fa2e04-d778-45c7-83aa-e829a23f19b3 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:34:26.142096 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-21fa2e04-d778-45c7-83aa-e829a23f19b3 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:34:26.142530 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-21fa2e04-d778-45c7-83aa-e829a23f19b3 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:34:26.175822 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-21fa2e04-d778-45c7-83aa-e829a23f19b3 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:34:26.176282 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG oslo_concurrency.lockutils [None req-21fa2e04-d778-45c7-83aa-e829a23f19b3 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:34:26.176730 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.objects.instance [None req-21fa2e04-d778-45c7-83aa-e829a23f19b3 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lazy-loading 'fault' on Instance uuid 67d74924-5509-4362-b314-27e375267a10 {{(pid=117509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:34:26.220087 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.policy [None req-21fa2e04-d778-45c7-83aa-e829a23f19b3 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246d8b08525243c893175a0aff2dabff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe6a9374c6d48e9933d6f099cc32bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117509) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:34:26.228460 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-21fa2e04-d778-45c7-83aa-e829a23f19b3 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 200 len: 1225 microversion: 2.1 time: 0.100047 May 25 16:34:26.229017 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 566/1123] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:34:26 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:34:27.246295 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-f899534e-2f20-4f93-b4dd-4423d4fed071 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '>' {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:34:27.246985 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.compute.api [None req-f899534e-2f20-4f93-b4dd-4423d4fed071 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] [instance: 67d74924-5509-4362-b314-27e375267a10] Fetching instance by UUID {{(pid=117510) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:34:27.253556 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f899534e-2f20-4f93-b4dd-4423d4fed071 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:34:27.254037 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f899534e-2f20-4f93-b4dd-4423d4fed071 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:34:27.254798 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f899534e-2f20-4f93-b4dd-4423d4fed071 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:34:27.255233 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG oslo_concurrency.lockutils [None req-f899534e-2f20-4f93-b4dd-4423d4fed071 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Lock "0666b19a-5b2e-43ea-b2cf-5adf4d938b08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:34:27.268769 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.wsgi [None req-f899534e-2f20-4f93-b4dd-4423d4fed071 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] HTTP exception thrown: Instance 67d74924-5509-4362-b314-27e375267a10 could not be found. May 25 16:34:27.270391 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-f899534e-2f20-4f93-b4dd-4423d4fed071 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Request method failure captured: May 25 16:34:27.270391 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: request: GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 HTTP/1.1 May 25 16:34:27.270391 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept: application/json May 25 16:34:27.270391 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Accept-Encoding: identity May 25 16:34:27.270391 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Connection: close May 25 16:34:27.270391 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Length: 0 May 25 16:34:27.270391 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Content-Type: application/json May 25 16:34:27.270391 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Host: 10.222.0.42 May 25 16:34:27.270391 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Openstack-System-Scope: None May 25 16:34:27.270391 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: User-Agent: python-urllib3/1.26.9 May 25 16:34:27.270391 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Auth-Token: gAAAAABijll1a3t9In-CzWo_mmCHBOFh9KmvkAQcp-bbMQHXeo6m3upYH-0aXLqVRcmMWAf_xNXmw-wQRfPvRze5ycP7KJ4tdvdPlIwMDh34mPXl_MFULWX2GWtNcgLuEwxAnTS5mudTtigrJwjPTpIgRxbx6r3DbnThWG22tqUKg7YbEsBPBqA May 25 16:34:27.270391 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Id: None May 25 16:34:27.270391 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Domain-Name: None May 25 16:34:27.270391 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Identity-Status: Confirmed May 25 16:34:27.270391 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Is-Admin-Project: True May 25 16:34:27.270391 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Id: default May 25 16:34:27.270391 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Domain-Name: Default May 25 16:34:27.270391 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Id: cfe6a9374c6d48e9933d6f099cc32bd2 May 25 16:34:27.270391 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Project-Name: tempest-TestShelveInstance-152824122 May 25 16:34:27.270391 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Role: reader,member May 25 16:34:27.270391 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Roles: reader,member May 25 16:34:27.272132 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cfe6a9374c6d48e9933d6f099cc32bd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cfe6a9374c6d48e9933d6f099cc32bd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cfe6a9374c6d48e9933d6f099cc32bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cfe6a9374c6d48e9933d6f099cc32bd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] May 25 16:34:27.272132 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant: tempest-TestShelveInstance-152824122 May 25 16:34:27.272132 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Id: cfe6a9374c6d48e9933d6f099cc32bd2 May 25 16:34:27.272132 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-Tenant-Name: tempest-TestShelveInstance-152824122 May 25 16:34:27.272132 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User: tempest-TestShelveInstance-152824122-project May 25 16:34:27.272132 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Id: default May 25 16:34:27.272132 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Domain-Name: Default May 25 16:34:27.272132 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Id: 246d8b08525243c893175a0aff2dabff May 25 16:34:27.272132 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: X-User-Name: tempest-TestShelveInstance-152824122-project May 25 16:34:27.272132 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: method: > May 25 16:34:27.272132 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: exception: Instance 67d74924-5509-4362-b314-27e375267a10 could not be found. May 25 16:34:27.272132 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: action_args: {'id': '67d74924-5509-4362-b314-27e375267a10'} May 25 16:34:27.273172 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: {{(pid=117510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:34:27.273172 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:34:27.273172 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:34:27.273172 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:34:27.273172 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:34:27.273172 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:34:27.273172 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:34:27.273172 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:34:27.273172 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:34:27.273172 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:34:27.273172 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67d74924-5509-4362-b314-27e375267a10 could not be found. May 25 16:34:27.273172 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:34:27.273172 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:34:27.273172 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:34:27.273172 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:34:27.273172 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:34:27.273172 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:34:27.273172 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:34:27.273172 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:34:27.273172 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:34:27.275295 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:34:27.275295 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:34:27.275295 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:34:27.275295 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:34:27.275295 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:34:27.275295 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:34:27.275295 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:34:27.275295 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67d74924-5509-4362-b314-27e375267a10 could not be found. May 25 16:34:27.275295 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:34:27.275295 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:34:27.275295 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:34:27.275295 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:34:27.275295 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:34:27.275295 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:34:27.275295 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:34:27.275295 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:34:27.275295 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67d74924-5509-4362-b314-27e375267a10 could not be found. May 25 16:34:27.275295 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: ERROR nova.api.openstack.wsgi May 25 16:34:27.276754 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: DEBUG nova.api.openstack.wsgi [None req-f899534e-2f20-4f93-b4dd-4423d4fed071 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Returning 404 to user: Instance 67d74924-5509-4362-b314-27e375267a10 could not be found. {{(pid=117510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:34:27.276754 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO nova.api.openstack.requestlog [None req-f899534e-2f20-4f93-b4dd-4423d4fed071 tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10" status: 404 len: 111 microversion: 2.1 time: 0.030205 May 25 16:34:27.276754 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: [pid: 117510|app: 0|req: 558/1124] 10.222.0.42 () {58 vars in 1235 bytes} [Wed May 25 16:34:27 2022] GET /compute/v2.1/servers/67d74924-5509-4362-b314-27e375267a10 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:34:27.436599 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: DEBUG nova.api.openstack.wsgi [None req-226c87a7-c046-4f59-933a-7613ad91953b tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] Calling method '.version_select at 0x7f51ee0699d0>' {{(pid=117509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:34:27.460221 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO nova.api.openstack.requestlog [None req-226c87a7-c046-4f59-933a-7613ad91953b tempest-TestShelveInstance-152824122 tempest-TestShelveInstance-152824122-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1717979148" status: 202 len: 0 microversion: 2.1 time: 0.030167 May 25 16:34:27.461380 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: [pid: 117509|app: 0|req: 567/1125] 10.222.0.42 () {58 vars in 1253 bytes} [Wed May 25 16:34:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1717979148 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:35:47.470569 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 16:35:47.471022 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Wed May 25 16:35:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 16:37:06.707236 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 16:37:06.707863 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Wed May 25 16:37:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 16:37:09.752782 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 16:37:09.753333 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Wed May 25 16:37:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 16:37:19.922463 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 16:37:19.923003 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Wed May 25 16:37:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 16:37:20.430702 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 16:37:20.431235 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Wed May 25 16:37:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 16:37:38.485260 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 16:37:38.485803 dv-cinder-843278-2-iscsi devstack@n-api.service[117509]: Wed May 25 16:37:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 16:39:07.479472 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 16:39:07.479977 dv-cinder-843278-2-iscsi devstack@n-api.service[117510]: Wed May 25 16:39:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!